AI.info

Kosuke Sato

Explore Kosuke Sato on AI.info.

• It's Not RoPE that Creates Sinks: The Role of Self-Concentration and Value-Non-Mixing in Attention