jobs

Software Engineer - Infrastructure

ABOUT BASETENBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless dev

Company

Baseten

Location

San Francisco; Remote; Toronto; New York; Montreal; Seattle

Status

Open

Posted

2025-03-09T23:39:59.239+00:00

Baseten runs inference infrastructure for AI companies, and this Infrastructure team role is about the platform that deploys, scales and monitors ML models. Work includes Python and Go services, Kubernetes deployments for model serving, an inference orchestration layer, GPU capacity across clouds, and monitoring for model performance. The posting asks for a CS degree, coding ability (Go a plus), Kubernetes and containerization knowledge, basic ML and model-serving understanding, and distributed systems familiarity. Projects named include multi-node inference and fractional H100 GPUs; equity is offered.