SemiAnalysis· Max Kan·· 4 days agoAI score58
GDPx: Measuring Frontier Model Capabilities Across the Most Valuable Domains
GDPx: Measuring Frontier Model Capabilities Across the Most Valuable Domains
AI summary
SemiAnalysis introduces GDPx, a benchmark covering domains such as chip design, cybersecurity, biology, finance, legal, quant trading, RSI, hardware design, materials science, alignment, and software engineering, built with 14 specialized data partners; the best model scores just 12%. The article argues OpenAI's GDPval is inadequate for today's agents because its tasks are non-interactive and lack realistic environments, and it details GDPx's QA process, per-domain task design, and model results including safety-classifier effects.
Source: SemiAnalysis · newsletter.semianalysis.com