Westphalia Labs tests 11 AI models as chairs of a fictional seven-government negotiation
Start here
Westphalia Labs, an evaluation group founded by a former diplomat, ran eleven AI models as chair of a fictional seven-government negotiation, with forty runs each across a possible and an impossible version. Only GPT-6.1 Sol passed every run, reaching agreement when agreement was possible and declaring consensus impossible when it was. Claude Opus 5.5, Grok 4.7 and the low-cost DeepSeek V4.1 Flash each identified the impossible version correctly every time and reached agreement in 18 of 20 possible runs. Among the failures, overreach caused 39 failed runs, against 13 caused by conceding too little. When a likely forecast was followed, agreement was reached in 72 of 110 cases.
Generated from reports · updated 14 h ago
Report timeline
Follow the reports to see the event from different sides.
- Hacker News · AIWestphalia Labs tests 11 AI models chairing a fictional seven-government negotiation
Westphalia Labs, an evaluation group founded by a former diplomat, ran eleven AI models as chair of a fictional seven-government negotiation, forty runs each across a possible and an impossible version. Only GPT-6.1 Sol passed every run, reaching agreement when possible and declaring consensus impossible when it was; Claude Opus 5.5, Grok 4.7 and the low-cost DeepSeek V4.1 Flash each called the impossible version correctly every time and agreed in 18 of 20 possible runs. Overreach caused 39 failed runs against 13 from conceding too little, and a likely forecast was followed by agreement in 72 of 110 cases.
Heat for this event
Not enough continuous observations yet to draw a trend.