jobs

Senior Software Engineer, GPU Infrastructure (HPC)

Who are we?Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.We’re training and deploying frontier models f

Company

Cohere

Location

Canada; United States

Status

Open

Posted

2026-09-03T21:28:21.241+00:00

Cohere's internal infrastructure team builds the systems used to train, evaluate and serve its foundation models. This role deploys and operates Kubernetes-based GPU and TPU superclusters across multiple clouds, tunes them for AI training with RDMA, NCCL and high-speed interconnects, debugs bottlenecks, and builds self-service tools so researchers can monitor and debug their own jobs. The posting asks for Kubernetes at scale, Python and Go, Linux internals, and experience with JAX, PyTorch or TensorFlow. All infrastructure roles include a compensated 24x7 on-call rotation.