Skip to content
Hacker News · AI·· 15 h agoAI score38

Terminal-Bench 4.1 Released with Hardened Verifiers Against Reward Hacking

Terminal-Bench 4.1

AI summary

Terminal-Bench 4.1 is released with improved verifiers designed to resist reward hacking, and regrading TB 4.0 with the new verifiers required $0 in additional inference cost. Only about 1.16% of 11,550 trials changed score, and all 35 agents' updated scores remain within their original TB 4.0 95% confidence intervals.

Source:Hacker News · AI · tbench.ai