Transformer Activations Form Metastable Token Clusters, Study Finds
Researchers experimentally verify that trained transformer models exhibit metastable token clustering predicted by an idealized attention theory, though the proposed energy dynamics and collapse speed predictions are falsified. The clustering depends on the value matrix rather than model size, highlighting nuanced mechanisms of attention dynamics.