MoE
Mixture of experts
An architecture that routes inputs through selected expert components. It can provide a large total parameter count while using only part of the model for each token.
By Mega AI Hub Editorial · Models & architecture
5,120,713 AI resources indexedWorking toward the world’s largest AI resource index.
Mixture of experts
An architecture that routes inputs through selected expert components. It can provide a large total parameter count while using only part of the model for each token.
By Mega AI Hub Editorial · Models & architecture