jobs
Research Scientist, Open Benchmarks Red Team
About Snorkel Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data…
Auf Englisch
- Company
- Snorkel AI
- Location
- New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)
- Status
- Open
- Posted
- 2026-11-13 19:06 UTC
Snorkel AI is hiring a researcher for its Open Benchmarks Red Team, part of a $30M program that funds and supports independent AI benchmark work. The role is hands-on: reproduce benchmark problems such as grader failures, shortcuts and task ambiguity; propose and test repairs with benchmark authors; and build reusable checks and methods. The posting asks for ML, LLM and AI-agent evaluation experience, strong Python, rigorous experimentation, and collaboration. Work is hybrid in New York City or San Francisco, or remote in the United States; pay is $200,000–$340,000.
Original job posting