jobs

Engineering Manager, Model Infrastructure

Why HarveyAt Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decade

Company

Harvey

Location

San Francisco

Status

Open

Posted

2026-07-22T00:08:59.705+00:00

Harvey is hiring an engineering manager to lead its Model Infrastructure team, the platform behind every model request in its legal AI product. The role covers the technical roadmap, multi-provider model provisioning, failover and incident response, a unified model controller that routes traffic by health, latency, quality, compliance and cost, plus observability, inference efficiency and groundwork for training Harvey's own models. The posting asks for 8+ years of software engineering, several years managing, and experience with large-scale distributed systems and highly available production services.