The Decoder· Matthias Bastian·· 1 hr agoAI score62
Gemini 4 Carbon takes the MathArena crown but costs 15 times more than GPT-6.1 Sol
Gemini 4 Carbon takes the MathArena crown but costs 15 times more than GPT-6.1 Sol
AI summary
Google's Gemini 4 Carbon became the first non-OpenAI model in a while to top the MathArena math benchmark, displacing GPT-6.1 Sol, with Claude Fable 5.2 taking second place. Its most common failure mode is exceeding the time limit, and in one case it ran a script for more than eleven hours without checking its progress. With the reasoning settings used in testing, Carbon and Fable 5.2 cost roughly 15 and 40 times as much as GPT-6.1 Sol, respectively.
Source: The Decoder · the-decoder.com