iCreatAI News
Skip to content
The Decoder· Manuel Uth·· 13 hr agoAI score58

No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark

No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark

AI summary

SemiAnalysis released GDPx, a benchmark of 206 tasks across eleven domains that places AI agents in simulated work environments operating professional software for up to eight hours. Claude Opus 5.5 leads at 12 percent, followed by Gemini 4 Carbon at 10.9 percent and GPT-6 Astra at 9.6 percent, and no model fully solves the finance and legal tasks. Critics including developer Josh Purtell call GDPx "more noise than signal," citing provider-specific agent software and small sub-domain task counts.

Source: The Decoder · the-decoder.com