jobs

Software Engineer - Model Performance Systems

ABOUT BASETENBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless dev

Company

Baseten

Location

San Francisco; Toronto; New York; Montreal; Seattle

Status

Open

Posted

2026-01-07T02:00:15.259+00:00

Baseten, which runs inference for AI companies, is hiring a software engineer for a role it describes as sitting between high-performance computing and LLM engineering. The work covers LLM benchmarking, GPU-backed internal development environments, profiling with PyTorch Profiler, Nsight Systems and py-spy, monitoring dashboards, CI performance testing, and tools for latency, cost and quality trade-offs. It asks for Python, C++ familiarity, systems depth, cross-team communication and mentoring. The posting calls the role mid-senior and says the hire leads a small team.