Ir para o conteúdo
AI.info

jobs

AI Benchmarking Lead, Performance Benchmarking Evaluation

Join our mission-critical team supporting Seller Assistant, Amazon's Gen-AI powered copilot that helps sellers navigate Amazon's complex ecosystem and grow their businesses.

Em inglês

Company
Amazon
Location
Hyderabad, Telangana, IND
Status
Closed
Posted
2026-09-29

Amazon's Seller Assistant, a generative-AI copilot for sellers, needs someone to benchmark its models for relevancy, correctness and completeness. The AI Benchmarking Lead quality-checks audits from the core auditing team, measures auditor accuracy, runs calibration sessions, finds rubric gaps and evaluation ambiguities, updates SOPs, and coordinates annotation work across ML data workflows. The posting asks for a bachelor's degree, data-annotation or language-labeling experience, Excel, basic SQL and Python, and gives 1–3 years as preferred. It reports progress to program managers and applied scientists.

Original job posting