jobs

Staff Software Engineer - ML Observability

The ML Observability team builds cutting-edge tools to monitor, explain, and improve AI systems in production, particularly those leveraging Large Language Models (LLMs) and generative AI. We provide robust, scalable observability for AI wo

Company

Datadog

Location

Boston, Massachusetts, USA; New York, New York, USA

Status

Open

Posted

2025-07-25T20:09:54+00:00

Datadog is hiring a Staff Software Engineer for its ML Observability team, based in Boston or New York. The person will lead development of LLM observability features, building tools to trace, evaluate, and debug LLMs, and work with engineering, product, UX, and applied science. The posting asks for deep distributed systems knowledge, hands-on LLM or GenAI application experience, and familiarity with model internals, inference, evaluation, prompt engineering, and observability platforms. Distinctive: shaping product direction and mentoring engineers in a changing area.