Zum Inhalt springen
AI.info

jobs

Software Engineer - GPU Networking & Distributed Systems

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer.

Auf Englisch

Company
Baseten
Location
San Francisco; Toronto; New York; Montreal; Seattle
Status
Open
Posted
2026-02-23 20:22 UTC

Baseten is hiring a software engineer to build the networking layer beneath its distributed LLM inference stack: integrating RDMA, RoCE and InfiniBand rather than TCP/IP, tuning communication for disaggregated KV cache offload and wide expert parallelism, cutting trillion-parameter model cold starts below ten seconds, validating throughput on H100 and Blackwell clusters, and writing communication kernels with NCCL and NVSHMEM. The posting asks for deep high-performance networking experience, C++ or Python, and NVIDIA memory-hierarchy knowledge. Hybrid, across five listed cities.

Original job posting