jobs

Staff Applied Scientist - Agentic Interfaces

Team description At Datadog, AI agents are becoming first-class consumers of observability, security, and software delivery data — from third-party coding agents like Claude Code, Cursor, and Copilot, to our own Bits SRE, Bits Assistant, an

Company

Datadog

Location

New York, New York, USA

Status

Open

Posted

2026-05-29T14:06:44+00:00

Datadog's Agentic Interfaces team is hiring a Staff Applied Scientist to own evaluation for its AI agent integrations. The work covers defining metrics for answer quality, tool-selection accuracy, retrieval relevance, latency and token cost, building eval datasets, golden traces and regression harnesses, and applied research on multi-turn agent evaluation and grounding on live telemetry. Asked for: BS/MS/PhD, 10+ years of engineering or applied science experience including technical lead work, and a record of leading ML or GenAI initiatives into production. Eval assets are meant to be reused across product groups.