Hacker News AI· jamest·· 2 days agoAI score58
KradleBench: Multi-agent AI evals in Minecraft
KradleBench: Multi-agent AI evals in Minecraft
AI summary
KradleBench evaluates top AI models on multi-agent tasks in Minecraft, finding that models coordinate well and generate recognizable objects but that a skilled human player, SethBling, still beats them at strategy and conflict. GPT-6.2 Astra ranks first overall at 78.28/100 with a $1.26 LLM cost per run, ahead of Gemini 4 Hydrogen (43.90) and Claude Opus 5.5 (39.12). Each run can be replayed interactively, and one highlighted run shows GPT-6.1 Sol turning its diamonds into a sword and armor to eliminate every rival.
Source: Hacker News AI · kradle.ai