AI.info

Wenxuan Zeng

Explore Wenxuan Zeng on AI.info.

• Attention Sink Forges Native MoE in Attention Layers: Sink-Aware Training to Address Head Collapse