jobs
Software Engineer - Inference Platform
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer.
Auf Englisch
- Company
- Baseten
- Location
- San Francisco; Toronto; New York; Montreal; Seattle
- Status
- Open
- Posted
- 2026-10-05 23:30 UTC
Baseten is hiring a software engineer for its Inference Platform team, which runs large-scale LLM inference for customers. The work spans a distributed runtime: deployment orchestration on Kubernetes, request routing, autoscaling and scheduling, plus Model APIs with structured outputs, tool calling and multimodal serving. Candidates need a degree or equivalent and 3+ years on distributed systems or large-scale APIs, plus profiling and SLO work. ML experience is not required; experience with serving engines such as vLLM or SGLang is a plus. The team is described as small.
Original job posting