5,545,805 AI resources indexedWorking toward the world’s largest AI resource index.

PDF

A Tale of Tails: Model Collapse as a Change of Scaling Laws

Research paper by Elvis Dohmatob and collaborators. Published 2024-02-10. Topics: neural scaling laws, model collapse, loss of scaling, shifted scaling, un-learning.

Resource information

Authors
Elvis Dohmatob, Yunzhen Feng, Pu Yang, Francois Charton, Julia Kempe
Research topics
neural scaling laws, model collapse, loss of scaling, shifted scaling, un-learning, grokking, transformer, arithmetic task, text generation, Llama2
Publication date
2024-02-10
Publication
arXiv
Last record update
Nov 3, 2026