New preprint! This time, we study (How) Learning Rates Regulate Catastrophic Overtraining. Update: accepted to COLM 2026!