The plates of the AI calendar
Switch Transformers: one expert per token
More parameters, the same computation for every token. The plate the AI.info front page drew for 11 Jan 2021, a day in the history of artificial intelligence.

11 JAN 2021 · Paper
more parameters, the same computation for every token
Drawn for 11 Jan 2021, on the front page on its day