Skip to content
AI.info

jobs

AI Benchmarking Specialist, Performance Benchmarking Evaluation

At Amazon, we're evolving how to support sellers, customers in solving their query resolved faster using AI. That is where our team steps in, we support multiple AI models in benchmarking their…

Company
Amazon
Location
Hyderabad, Telangana, IND
Status
Closed
Posted
2026-09-30

Amazon's Performance Benchmarking Evaluation team in Hyderabad is hiring an AI Benchmarking Specialist. The work is annotation and evaluation of AI model responses, judging relevancy, correctness and completeness, plus structuring data collection, analysing results, maintaining and auditing SOPs, testing new tools, and reporting productivity and quality metrics to program managers and applied scientists. A bachelor's degree, fluent English, Excel and Microsoft Office are required; up to a year of annotation experience and SQL or Python for data analysis are preferred. On-site, full-time.

Original job posting