KradleBench launches Minecraft multi-agent AI benchmark
Start here
Kradle has released KradleBench, a benchmark that tests frontier AI models on multi-agent tasks in Minecraft across five categories: collaboration, economy, conflict, logic and creativity. GPT-6.2 Astra ranks first overall with 78.28 out of 100, at an LLM cost of $1.26 per run. In a comparison with a human player, skilled Minecraft player SethBling still beats the models in the economy and conflict categories, but trails them on the solo logic and creativity challenges. Each benchmark run can be replayed as an interactive recording.
Generated from reports · updated 1 d ago
Report timeline
Follow the reports to see the event from different sides.
- Hacker News · AIKradleBench launches a Minecraft-based multi-agent benchmark for frontier models
KradleBench is a new benchmark that evaluates multi-agent AI models inside Minecraft across collaboration, economy, conflict, logic and creativity tasks. GPT-6.2 Astra ranks first overall at 78.28/100 with $1.26 LLM cost per run, while skilled human player SethBling beats frontier models at economy and conflict but trails them on solo logic and creativity challenges. Every run can be replayed as an interactive recording.
- Hacker News · AIKradleBench benchmarks multi-agent AI models in Minecraft
KradleBench, a benchmark from Kradle, evaluates frontier models on multi-agent tasks in Minecraft across collaboration, economy, conflict, logic and creativity. GPT-6.2 Astra ranks first overall at 78.28/100 with an LLM cost of $1.26 per run, while skilled player SethBling still beats the models at economy and conflict but trails them on solo logic and creativity challenges. Every run can be replayed as an interactive replay.
Heat for this event
- Current, comparable range
- 5
- Peak, comparable range
- 10November 19 04:00
- Change in 24 hours
- -48%
The trend compares the same participants over hours observed continuously, so its range can be narrower than the current heat count. Hover or tap the chart for hourly heat; the arrow keys move through it.