Prospective Prediction of OOD Degradation from Source-Side Training Dynamics
The paper reports an early warning signal for later OOD failure using only source-side training behavior.
In a controlled shortcut-learning setup, a logistic regression predictor found a prospective signal where training time alone did not. The abstract says temporal summaries of source-side quantities were more informative than current values. Confidence and entropy dynamics still carried predictive information when transferred from a CNN to an MLP without extra training. ArXiv · AI/CL/LG's note
In a controlled shortcut-learning setup, a logistic regression predictor found a prospective signal where training time alone did not. The abstract says temporal summaries of source-side quantities were more informative than current values. Confidence and entropy dynamics still carried predictive information when transferred from a CNN to an MLP without extra training. ArXiv · AI/CL/LG's note
score 3