Amazon Taps AVERI for Independent Review of Its AI Safety Evaluation Datasets

Amazon partnered with independent nonprofit AVERI to review the quality of its internal safety evaluation datasets, not just model outputs. AVERI validated topical coverage, prompt diversity, and low contamination risk, while recommending broader multilingual coverage, more multistep adversarial prompts, and clearer grading criteria. Amazon responded with refreshed test sets, tiered difficulty levels, and a quarterly review cadence.