Aller au contenu
AI.info

jobs

AI Infrastructure Engineer, Serving Platform

As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting-edge research and…

En anglais

Company
Scale AI
Location
London, UK
Status
Closed
Posted
2026-07-24 07:55 UTC

Scale AI is hiring a software engineer for its ML Infrastructure team in London, on-site, to build and maintain fault-tolerant systems for serving large language models at scale. The work spans an internal platform for LLM capability discovery, integrating models with researchers, design reviews, and monitoring and observability. The posting asks for four or more years building large-scale backend systems, strong Python, Go, Rust or C++, and knowledge of LLM serving concepts, containers and cloud infrastructure. Experience with vLLM or similar serving frameworks is listed as a plus.

Original job posting