Ai2 releases XYBench, an 8K-question benchmark for the XY problem in AI assistant answers

Ai2 released XYBench, a benchmark of 8,115 real-world questions that tests whether AI assistants recognize when a user's request rests on a misconception and steer them toward their actual goal; the work won the Best Resource Paper Award at EMNLP 2026.