AI.info

Keith Rush

Explore Keith Rush on AI.info.

• Mixture of Training: Recombining Small-Scale Scaffolded Pretraining Runs into a Larger Language Model