jobs

Senior Software Engineer, ML API – AI Inference

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference serv

Company

Cerebras

Location

Toronto, CAN; Sunnyvale, CA

Status

Open

Posted

2026-10-27T19:51:12.823+00:00

Cerebras is hiring a senior software engineer to build the ML API layer for its disaggregated inference system, which pairs GPU prefill with decode on the Cerebras Wafer-Scale Engine. The role covers chat completions, streaming, tool calling, structured outputs, multimodal inputs and request routing, plus integrating models and frameworks such as vLLM, PyTorch and Hugging Face. The posting asks for 5+ years of engineering experience, strong Python and a second language (Go, C++, Rust), API design, Kubernetes and CI/CD, and distributed-systems debugging. What stands out is the explicit mix of ML systems, API design and production reliability, with room to lead small projects and mentor.