Our paper on analyzing self-attention networks is accepted to the International Conference on Machine Learning (ICML)：

Han Bao, Ryuichiro Hataya, Ryo Karakida. Self-attention Networks Localize When QK-eigenspectrum Concentrates. In Proceedings of the 41st International Conference on Machine Learning (ICML), 2024.