OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework
Research paper by Sachin Mehta and collaborators. Published 2024-04-22. Topics: layer-wise scaling, transformer model, OpenELM, OLMo, pre-training tokens.
Resource information
- Authors
- Sachin Mehta, Mohammad Hossein Sekhavat, Qingqing Cao, Maxwell Horton, Yanzi Jin, Chenfan Sun, Iman Mirzadeh, Mahyar Najibi, Dmitry Belenko, Peter Zatloukal, Mohammad Rastegari
- Research topics
- layer-wise scaling, transformer model, OpenELM, OLMo, pre-training tokens, training logs, checkpoints, pre-training configurations, MLX library
- Publication date
- 2024-04-22
- Publication
- arXiv
- Last record update
- Nov 3, 2026