Keyword:Mixture of Experts

Publications
Developing Optimized Large Language Models on Limited Compute Resources S Kasinadhsarma EasyChair Preprint 15800
Efficient Sequence Pooling Model for Sparse Attention with Mixture of Experts Sk Sayril Amed EasyChair Preprint 15262