Ir para o conteúdo
AI.info

jobs

Software Engineer, Training/Inference (C++)

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the…

Em inglês

Company
xAI
Location
Palo Alto, CA; Seattle, WA
Status
Open
Posted
2024-10-05 00:14 UTC

xAI is hiring a software engineer for its inference team in Palo Alto, on-site, to build the platform serving the Grok model to millions of users. The work spans distributed serving infrastructure — global KV cache, continuous batching, load balancing, auto-scaling — plus GPU kernel work, quantization, speculative decoding, latency and throughput tuning, and CI/CD for endpoint deployment. The posting asks for deep C/C++ or Rust systems programming, large-scale production serving, and experience with inference engines including vLLM, SGLang, Triton or TensorRT-LLM. Base pay is listed at $180,000–$440,000.

Original job posting