TinyLlama: An Open-Source Small Language Model
Research paper by Peiyuan Zhang and collaborators. Published 2024-01-04. Topics: FlashAttention, Llama 2, TinyLlama, language model.
Resource information
- Authors
- Peiyuan Zhang, Guangtao Zeng, Tianduo Wang, Wei Lu
- Research topics
- FlashAttention, Llama 2, TinyLlama, language model
- Publication date
- 2024-01-04
- Publication
- arXiv
- Last record update
- Nov 3, 2026