Skip to content
Hot eventDeveloping

KradleBench launches Minecraft multi-agent AI benchmark

2 reports1 reporting sourcesUpdated 1 d ago

Start here

AI digest

Kradle has released KradleBench, a benchmark that tests frontier AI models on multi-agent tasks in Minecraft across five categories: collaboration, economy, conflict, logic and creativity. GPT-6.2 Astra ranks first overall with 78.28 out of 100, at an LLM cost of $1.26 per run. In a comparison with a human player, skilled Minecraft player SethBling still beats the models in the economy and conflict categories, but trails them on the solo logic and creativity challenges. Each benchmark run can be replayed as an interactive recording.

Generated from reports · updated 1 d ago

Report timeline

Follow the reports to see the event from different sides.

November 19
  1. Hacker News · AI
    KradleBench launches a Minecraft-based multi-agent benchmark for frontier models

    KradleBench is a new benchmark that evaluates multi-agent AI models inside Minecraft across collaboration, economy, conflict, logic and creativity tasks. GPT-6.2 Astra ranks first overall at 78.28/100 with $1.26 LLM cost per run, while skilled human player SethBling beats frontier models at economy and conflict but trails them on solo logic and creativity challenges. Every run can be replayed as an interactive recording.

  2. Hacker News · AI
    KradleBench benchmarks multi-agent AI models in Minecraft

    KradleBench, a benchmark from Kradle, evaluates frontier models on multi-agent tasks in Minecraft across collaboration, economy, conflict, logic and creativity. GPT-6.2 Astra ranks first overall at 78.28/100 with an LLM cost of $1.26 per run, while skilled player SethBling still beats the models at economy and conflict but trails them on solo logic and creativity challenges. Every run can be replayed as an interactive replay.

Heat for this event

Current, comparable range
5
Peak, comparable range
10November 19 04:00
Change in 24 hours
-48%

The trend compares the same participants over hours observed continuously, so its range can be narrower than the current heat count. Hover or tap the chart for hourly heat; the arrow keys move through it.