jobs
AI Benchmarking Specialist, Performance Benchmarking Evaluation
At Amazon, we're evolving how to support sellers, customers in solving their query resolved faster using AI. That is where our team steps in, we support multiple AI models in benchmarking their…
En anglais
- Company
- Amazon
- Location
- Hyderabad, Telangana, IND
- Status
- Closed
- Posted
- 2026-09-30
Amazon's Performance Benchmarking Evaluation team in Hyderabad is hiring an AI Benchmarking Specialist. The work is annotation and evaluation of AI model responses, judging relevancy, correctness and completeness, plus structuring data collection, analysing results, maintaining and auditing SOPs, testing new tools, and reporting productivity and quality metrics to program managers and applied scientists. A bachelor's degree, fluent English, Excel and Microsoft Office are required; up to a year of annotation experience and SQL or Python for data analysis are preferred. On-site, full-time.
Original job posting