jobs
(Staff / Senior Staff) AI Inference Reliability Engineer, Compute Infra
About The Role We're looking for a software engineer, reliability-minded but still a builder, to own what happens in production to the Kubernetes-native control plane that provisions and runs our GPU…
In inglese
- Company
- Together AI
- Location
- San Francisco
- Status
- Open
- Posted
- 2026-10-20 22:37 UTC
Together AI is hiring a staff or senior staff engineer to keep its GPU inference platform reliable in production. The role owns the Kubernetes-based control plane that provisions inference capacity, troubleshoots InfiniBand/RDMA and LoRA-serving failures, extends automated repair, and sets SLOs and incident response. Candidates need production reliability experience on large distributed or GPU-serving systems, Kubernetes controllers, and hands-on networking diagnosis. The distinctive emphasis is turning each new failure into automation and treating GPU infrastructure as software.
Original job posting