jobs

AI Infrastructure Engineer, Serving Platform

As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting-edge research and production systems, supporting both internal and

In inglese

Company

Scale AI

Location

London, UK

Status

Closed

Posted

2026-07-24T07:55:57+00:00

Scale AI is hiring a software engineer for its ML Infrastructure team in London, on-site, to build and maintain fault-tolerant systems for serving large language models at scale. The work spans an internal platform for LLM capability discovery, integrating models with researchers, design reviews, and monitoring and observability. The posting asks for four or more years building large-scale backend systems, strong Python, Go, Rust or C++, and knowledge of LLM serving concepts, containers and cloud infrastructure. Experience with vLLM or similar serving frameworks is listed as a plus.