Aller au contenu
AI.info

jobs

Software Engineer - Inference Platform

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer.

En anglais

Company
Baseten
Location
San Francisco; Toronto; New York; Montreal; Seattle
Status
Open
Posted
2026-10-05 23:30 UTC

Baseten is hiring a software engineer for its Inference Platform team, which runs large-scale LLM inference for customers. The work spans a distributed runtime: deployment orchestration on Kubernetes, request routing, autoscaling and scheduling, plus Model APIs with structured outputs, tool calling and multimodal serving. Candidates need a degree or equivalent and 3+ years on distributed systems or large-scale APIs, plus profiling and SLO work. ML experience is not required; experience with serving engines such as vLLM or SGLang is a plus. The team is described as small.

Original job posting