AI.info

Satoki Ohashi

Explore Satoki Ohashi on AI.info.

• It's Not RoPE that Creates Sinks: The Role of Self-Concentration and Value-Non-Mixing in Attention