Aller au contenu
AI.info

jobs

Software Engineer - Baseten Inference Stack

Baseten’s Inference Stack team builds the distributed runtime that serves large language models across the company’s platform. The team is hiring a software engineer to develop infrastructure and…

En anglais

Company
Baseten
Location
San Francisco, Montreal, New York, or Toronto
Status
Closed
Posted
2026-09-29 03:36 UTC

Baseten's Inference Stack team is hiring a software engineer for the distributed runtime that serves large language models on its platform. The work covers routing, autoscaling, scheduling, observability and runtime management, plus production debugging across Kubernetes, networking and GPU workloads, and partnering with model performance engineers to make inference optimizations configurable for customers. Projects run from architecture through deployment, monitoring and iteration. The posting lists full-time hybrid work across four cities and $180,000–$360,000 plus equity; experience requirements are in the full posting.

Original job posting