Aller au contenu
AI.info

jobs

Forward Deployed Engineer, Inference

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

En anglais

Company
Cohere
Location
United States
Status
Open
Posted
2026-10-28 21:49 UTC

Cohere seeks a Staff Forward Deployed Engineer for Inference to embed with enterprise customers and make its language models run in their own infrastructure. The work covers model-serving architecture, multi-tenant routing, cross-datacenter failover, Kubernetes deployments, benchmarking, latency and throughput troubleshooting, and validation on GPUs, TPUs and custom accelerators. The posting asks for eight or more years in production infrastructure or distributed systems, deep Kubernetes and LLM-inference knowledge, experience with engines such as vLLM or TensorRT-LLM, and customer-facing technical leadership. The role combines inference engineering with enterprise deployment.

Original job posting