jobs

AI Infrastructure System Engineer Bangalore

About the Role At Together AI, you’ll build and operate one of the world’s largest GPU fleets used for frontier model training and inference. This isn’t a traditional infrastructure role—we’re looking for engineers who love building systems

Company

Together AI

Location

Bangalore, India

Status

Open

Posted

2026-07-13T16:32:15+00:00

Together AI is hiring an AI Infrastructure System Engineer in Bangalore, on-site and full-time, to build and run GPU clusters used for frontier model training and inference. The work covers fleet automation that provisions, deploys and repairs thousands of GPUs, agents for autonomous remediation, and monitoring platforms for hardware, networking and storage. The posting asks for 3+ years on distributed systems or large-scale backend software, Python, Go or Rust, and tools such as Linux, Kubernetes, Terraform and Ansible. It favours an automation-first mindset.