AI.info

Runsheng Wang

Explore Runsheng Wang on AI.info.

• Attention Sink Forges Native MoE in Attention Layers: Sink-Aware Training to Address Head Collapse