AWS Machine Learning Blog· Bharathi Srinivasan·· 3 d agoAI score38
Amazon Bedrock AgentCore Evaluations: Built-in, DeepEval and AutoEval evaluators
The agent evaluation playbook: Built-in, DeepEval, and AutoEval on Amazon Bedrock AgentCore Evaluations
AI summary
Amazon Bedrock AgentCore Evaluations now lets teams run AWS built-in evaluators alongside managed DeepEval and AutoEval metrics, plus custom evaluators derived from either. The built-in catalog spans 15 evaluators across response quality, goal completion, tool use, skills and safety, with three trajectory checks for expected tool paths. DeepEval adds multi-turn metrics such as ConversationCompleteness and KnowledgeRetention, while AutoEval contributes specialized signals including security.
Source:AWS Machine Learning Blog · aws.amazon.com