2025 ICML ICML 2025

A Theoretical Study of (Hyper) Self-Attention through the Lens of Interactions: Representation, Training, Generalization