jobs

Software Engineer - Training/Inference (C++)

SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for indivi

Company

xAI

Location

Palo Alto, CA

Status

Open

Posted

2024-10-05T00:14:13+00:00

xAI is hiring a software engineer for its inference team in Palo Alto, on-site, to build the platform serving the Grok model to millions of users. The work spans distributed serving infrastructure — global KV cache, continuous batching, load balancing, auto-scaling — plus GPU kernel work, quantization, speculative decoding, latency and throughput tuning, and CI/CD for endpoint deployment. The posting asks for deep C/C++ or Rust systems programming, large-scale production serving, and experience with inference engines including vLLM, SGLang, Triton or TensorRT-LLM. Base pay is listed at $180,000–$440,000.