AI.info

Keisuke Sakaguchi

Explore Keisuke Sakaguchi on AI.info.

• It's Not RoPE that Creates Sinks: The Role of Self-Concentration and Value-Non-Mixing in Attention