jobs
Software Engineer - Model Performance Systems
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer.
Em inglês
- Company
- Baseten
- Location
- San Francisco; Toronto; New York; Montreal; Seattle
- Status
- Open
- Posted
- 2026-01-07 02:00 UTC
Baseten, which runs inference for AI companies, is hiring a software engineer for a role it describes as sitting between high-performance computing and LLM engineering. The work covers LLM benchmarking, GPU-backed internal development environments, profiling with PyTorch Profiler, Nsight Systems and py-spy, monitoring dashboards, CI performance testing, and tools for latency, cost and quality trade-offs. It asks for Python, C++ familiarity, systems depth, cross-team communication and mentoring. The posting calls the role mid-senior and says the hire leads a small team.
Original job posting