jobs

Staff Software Engineer, Model Infrastructure

Why HarveyAt Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decade

Company

Harvey

Location

San Francisco

Status

Open

Posted

2026-09-06T21:50:17.241+00:00

Harvey is hiring a staff software engineer for its Model Infrastructure team in San Francisco, hybrid. The role leads design of the platform behind every AI request: a unified model controller routing traffic across providers by reliability, latency, quality, compliance and cost, plus failover, capacity provisioning, provider integrations and observability. The posting wants seven-plus years building large-scale distributed systems, strength in Go, Java, Python, Rust or C++, and cross-team technical leadership. Distinctive: multi-provider model routing and work with AI research on evaluation and deployment foundations. Pay: $231,000–$340,000 USD.