Projects funded by the NCN
Uncovering the Mysteries of MoE: Developing better understanding and performance of Mixture-of-Experts Transformers
2025/57/N/ST6/04362
Keywords:
neural networks Mixture-of-Experts language modeling transformer
Descriptors:
- ST6_11:
Panel:
ST6 - Computer science and informatics: informatics and information systems, computer science, scientific computing, intelligent systems
Host institution :
Instytut Podstawowych Problemów Techniki Polska Akademia Nauk
woj. mazowieckie
Principal investigator (from the host institution):
Number of co-investigators in the project: 2
Call: PRELUDIUM 24 - announced on 2025-03-17
Amount awarded: 124 806 PLN
Project start date (Y-m-d): 2026-01-20
Project end date (Y-m-d): 2028-01-19
Project duration:: 24 months (the same as in the proposal)
Project status: Pending project
Project description
Download the project description in a pdf file
Note - project descriptions were prepared by the authors of the applications themselves and placed in the system in an unchanged form.