jobs

Staff Software Engineer, Inference Infrastructure

Who are we?Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.We’re training and deploying frontier models f

In inglese

Company

Cohere

Location

San Francisco; New York; Toronto; Montreal

Status

Open

Posted

2026-01-12T22:53:17.094+00:00

Cohere is hiring a staff engineer for its Model Serving team, which builds, deploys and runs the platform that serves its large language models through API endpoints. The work covers optimized NLP model deployment into low-latency, high-throughput, highly available production environments, custom customer deployments, and cost and resource management. The posting asks for 5+ years running large-scale production infrastructure, Kubernetes with GPU workloads, multi-cloud and Linux experience, familiarity with accelerator performance characteristics, distributed systems, and Go or C++. Hybrid across four listed cities.