The Most Important Charts in AI Are Wrong
The Most Important Charts in AI Are Wrong
Real-world data from OpenAI and Google shows that AI models complete internal work tasks of only about 9–16 minutes at 80% success, far below the 30–40 hours or months projected by METR/ECI extrapolations and the AI 2027 scenario, with the gap widening over time. The author argues that AI is more capable than reliable, that high-reliability task lengths remain short, and that the estimated self-improvement loop (about 3.6% faster experimentation per ECI point) stays below the 15–19% threshold for self-sustaining recursive self-improvement. The piece calls for greater transparency from AI companies, especially Anthropic, which it says forced METR to redact key evidence.
Source: Hacker News AI · rameznaam.com