A Tale of Tails: Model Collapse as a Change of Scaling Laws
Research paper by Elvis Dohmatob and collaborators. Published 2024-02-10. Topics: neural scaling laws, model collapse, loss of scaling, shifted scaling, un-learning.
Resource information
- Authors
- Elvis Dohmatob, Yunzhen Feng, Pu Yang, Francois Charton, Julia Kempe
- Research topics
- neural scaling laws, model collapse, loss of scaling, shifted scaling, un-learning, grokking, transformer, arithmetic task, text generation, Llama2
- Publication date
- 2024-02-10
- Publication
- arXiv
- Last record update
- Nov 3, 2026
