Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order
Research paper by Taishi Nakamura and collaborators. Published 2024-03-30. Topics: pretrained language models, multilingual capabilities, continual pretraining, catastrophic forgetting, open-source model.
Resource information
- Authors
- Taishi Nakamura, Mayank Mishra, Simone Tedeschi, Jason T Stillerman, Felix Friedrich, Prateek Yadav, Tanmay Laud, Vu Minh Chien, Terry Yue Zhuo, Diganta Misra, Ben Bogin, Xuan-Son Vu, Marzena Karpinska, Arnav Varma Dantuluri, Wojciech Kusa, Tommaso Furlanello, Rio Yokota, Niklas Muennighoff, Suhas Pai, Tosin Adewumi, Veronika Laippala, Xiaozhe Yao, Adalberto Junior, Alpay Ariyak, Aleksandr Drozd, Jordan Clive, Kshitij Gupta, Liangyu Chen, Qi Sun, Ken Tsui, Noah Persaud, Nour Fahmy, Tianlong Chen, Mohit Bansal, Nicolo Monti, Tai Dang, Ziyang Luo, Tien-Tung Bui, Roberto Navigli, Virendra Mehta, Matthew Blumberg, Victor May, Huu Nguyen, Sampo Pyysalo
- Research topics
- pretrained language models, multilingual capabilities, continual pretraining, catastrophic forgetting, open-source model, StarCoderPlus, human-reviewed safety instructions, Biden-Harris Executive Order, robustness, safety evaluations
- Publication date
- 2024-03-30
- Publication
- arXiv
- Last record update
- Nov 3, 2026