AI.info

Yuji Yamamoto

Explore Yuji Yamamoto on AI.info.

• It's Not RoPE that Creates Sinks: The Role of Self-Concentration and Value-Non-Mixing in Attention