New preprint! This time, we study (How) Learning Rates Regulate Catastrophic Overtraining.