Skip to content
AI.info

jobs

Software Engineer, Model Routing & Inference

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the…

Company
Cursor
Location
New York, NY; San Francisco, CA
Status
Closed
Posted
2026-11-10 06:34 UTC

Software engineer role on the Model Routing & Inference team, building the platform that routes AI requests across model providers. The work covers an inference gateway that standardizes provider APIs, cross-provider failover, backpressure and admission control, and cost/performance decisions around GPU utilization and capacity planning. The posting asks for high-throughput, low-latency distributed-systems experience—inference serving, traffic routing or real-time data pipelines—and a technical degree or two years of professional software work. Distinctive points: the team owns the full inference path and aims to make model onboarding a config change.

Original job posting