Megadose Built for builders and researchers.

Scaling Repeated-Data Pretraining: Batch Size, Regularization, and GPU-Time Tradeoffs

· HF Daily Papers ·

score 5

Categories: Research