We have <a href="https://openreview.net/pdf?id=lniwJxd2cT">a short paper</a> with preliminary results from our new project: "On the Emergence of 'Useless' Features in Next Token Predictors." It was presented as a spotlight paper at ICML 2025 Workshop on Assessing and Evaluating World Models!