Research paper
OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework
Research paper by Sachin Mehta and collaborators. Published 2024-04-22. Topics: layer-wise scaling, transformer model, OpenELM, OLMo, pre-training tokens.
Sachin Mehta, Mohammad Hossein Sekhavat, Qingqing Cao, Maxwell Horton, Yanzi Jin, Chenfan Sun, Iman Mirzadeh, Mahyar Najibi, Dmitry Belenko, Peter Zatloukal, Mohammad Rastegari
Not specifiedView resource