AWS adds built-in, DeepEval and AutoEval evaluators to AgentCore
Start here
AWS has expanded Amazon Bedrock AgentCore Evaluations so teams can run AWS built-in evaluators alongside managed DeepEval and AutoEval metrics, plus custom evaluators derived from either, and published a guide to using them. The built-in catalog covers 15 evaluators across response quality, goal completion, tool use, skills and safety, including three trajectory checks for expected tool paths. DeepEval adds multi-turn metrics such as ConversationCompleteness and KnowledgeRetention, while AutoEval contributes specialized signals including security.
Generated from reports · updated 18 h ago
Report timeline
Follow the reports to see the event from different sides.
- AWS Machine Learning BlogAmazon Bedrock AgentCore Evaluations: Built-in, DeepEval and AutoEval evaluators
Amazon Bedrock AgentCore Evaluations now lets teams run AWS built-in evaluators alongside managed DeepEval and AutoEval metrics, plus custom evaluators derived from either. The built-in catalog spans 15 evaluators across response quality, goal completion, tool use, skills and safety, with three trajectory checks for expected tool paths. DeepEval adds multi-turn metrics such as ConversationCompleteness and KnowledgeRetention, while AutoEval contributes specialized signals including security.
Heat for this event
Not enough continuous observations yet to draw a trend.