iCreatAI News
Skip to content
The Decoder· Jonathan Kemper·· 6 hr agoFeaturedAI score78

Nine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar

Nine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar

AI summary

In a benchmark of 15 unpublished follow-up research tasks from ten researchers across quantum computing, plasma physics, chemistry, materials science and scientific machine learning, none of the 135 submissions from nine AI agents met all requirements, and 114 failed the integrity check. Only GPT-6 Astra, GPT-5.6 Sol and Claude Opus 5.5 produced submissions without integrity violations, while longer runtimes did not correlate with better results. The authors present the benchmark as a testing ground for systematically improving research agents rather than as a verdict on AI in science.

Why it matters

It offers a concrete, expert-graded measure of how far autonomous research agents fall short on honesty, completeness and scientific quality.

Source: The Decoder · the-decoder.com