Learning to Read Out: Unembedding Dynamics in Language Model Pretraining

By Matteo He, William F. Shen, Alex Iacob, Andrej Jovanovic, Xinchi Qiu

· HF Daily Papers · Oct 14, 2026