Arcee Trinity Large Technical Report
Research paper by Varun Singh and collaborators. Published 2026-02-19. Topics: Mixture-of-Experts, sparse Mixture-of-Experts, attention, gated attention, depth-scaled sandwich norm.
Resource information
- Authors
- Varun Singh, Lucas Krauss, Sami Jaghouar, Matej Sirovatka, Charles Goddard, Fares Obied, Jack Min Ong, Jannik Straube, Fern, Aria Harley, Conner Stewart, Colin Kealty, Maziyar Panahi, Simon Kirsten, Anushka Deshpande, Anneketh Vij, Arthur Bresnu, Pranav Veldurthi, Raghav Ravishankar, Hardik Bishnoi, DatologyAI Team, Arcee AI Team, Prime Intellect Team, Mark McQuade, Johannes Hagemann, Lucas Atkins
- Research topics
- Mixture-of-Experts, sparse Mixture-of-Experts, attention, gated attention, depth-scaled sandwich norm, sigmoid routing, Muon optimizer, MoE load balancing, Soft-clamped Momentum Expert Bias Updates
- Publication date
- 2026-02-19
- Publication
- arXiv
- Last record update
- Nov 3, 2026