creators

Sebastian Ruder: multilingual NLP researcher

Sebastian Ruder is a research scientist at Meta in Berlin working on multilingual LLMs and evaluation, co-author of ULMFiT and author of NLP News.

Sebastian Ruder is a research scientist at Meta, based in Berlin, where he works on the multilingual capabilities of large language models and on LLM evaluation. He previously led the multilingual team at Cohere and was a research scientist at Google DeepMind and at the Dublin startup AYLIEN. He holds a PhD in natural language processing and deep learning from the Insight Research Centre for Data Analytics, and earlier studied computational linguistics at the University of Heidelberg and Trinity College Dublin. With Jeremy Howard he co-authored ULMFiT, the transfer-learning method for text classification published at ACL 2018, and he has long written on transfer learning, multilingual NLP and gradient descent optimization at ruder.io. He maintains NLP-progress, which tracks state-of-the-art results across NLP tasks and shows 23,000 GitHub stars. His newsletter NLP News lists over 30,000 subscribers, though its most recent issue is dated May 2024.

Specialization

multilingual NLP, LLM evaluation, transfer learning

Country

Germany