Megadose Models, research, and what moved.

A Scaling Theory of Multi-Epoch Pretraining: Late-Time Overfitting and Ensembling

· ArXiv · AI/CL/LG ·

score 5

Categories: Research