jobs

Software Engineer - Baseten Inference Stack

ABOUT BASETENBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless dev

Company

Baseten

Location

San Francisco; Toronto; New York; Montreal; Seattle

Status

Open

Posted

2026-06-02T00:16:06.843+00:00

Baseten's Inference Stack team builds the distributed runtime behind large-scale LLM inference on its platform. The engineer works across the stack: customer-facing deployment features, libraries for tool calling and reasoning, and the Kubernetes systems that orchestrate deployments and route traffic. Responsibilities include routing, autoscaling, scheduling, observability, reliability, and debugging production systems spanning networking and GPUs. The posting asks for a CS or engineering degree and a strong distributed-systems or platform-engineering background; prior work on vLLM, SGLang, TensorRT-LLM, Dynamo, or Kubernetes operators is a plus.