iCreatAI News
Skip to content
SemiAnalysis· Max Kan·· 4 days agoAI score58

GDPx: Measuring Frontier Model Capabilities Across the Most Valuable Domains

GDPx: Measuring Frontier Model Capabilities Across the Most Valuable Domains

AI summary

SemiAnalysis introduces GDPx, a benchmark covering domains such as chip design, cybersecurity, biology, finance, legal, quant trading, RSI, hardware design, materials science, alignment, and software engineering, built with 14 specialized data partners; the best model scores just 12%. The article argues OpenAI's GDPval is inadequate for today's agents because its tasks are non-interactive and lack realistic environments, and it details GDPx's QA process, per-domain task design, and model results including safety-classifier effects.

Source: SemiAnalysis · newsletter.semianalysis.com