iCreatAI News
Skip to content
Hacker News AI· simonkk·· 56 min agoAI score58

SatBench a Benchmark of AI Benchmarks

SatBench a Benchmark of AI Benchmarks

AI summary

SatBench treats the 173 benchmarks AI labs cite most as questions on one exam, where a question counts as solved once the best reported AI score reaches 85%, and finds 109 of 173 (63%) are solved, up from about 30% between 2023 and early 2025. Its own first edition of 44 benchmarks crossed 85% in September 2026, and the share solved within a year of release rose from 17% for 2023 releases to 43% for 2025. A companion analysis finds the 2023 benchmark canon is extinct at the frontier, with 2 of 134 frontier-lab launch posts in 2026 naming MMLU, HumanEval, GSM8K, MATH, BBH, HellaSwag, DROP or MGSM, and notes that counting only independent runs puts SatBench at 24% rather than 63%.

Source: Hacker News AI · github.com