iCreatAI News
Skip to content
Hacker News AI· jamest·· 2 days agoAI score58

KradleBench: Multi-agent AI evals in Minecraft

KradleBench: Multi-agent AI evals in Minecraft

AI summary

KradleBench evaluates top AI models on multi-agent tasks in Minecraft, finding that models coordinate well and generate recognizable objects but that a skilled human player, SethBling, still beats them at strategy and conflict. GPT-6.2 Astra ranks first overall at 78.28/100 with a $1.26 LLM cost per run, ahead of Gemini 4 Hydrogen (43.90) and Claude Opus 5.5 (39.12). Each run can be replayed interactively, and one highlighted run shows GPT-6.1 Sol turning its diamonds into a sword and armor to eliminate every rival.

Source: Hacker News AI · kradle.ai