Hacker News AI· anmejia·· 3 days agoAI score43
CloudOpsBench: AI benchmark shows FAI models struggling with cloud infra
CloudOpsBench: AI benchmark shows FAI models struggling with cloud infra
AI summary
CloudOpsBench is a benchmark for AI agents on real cloud operations, and its leaderboard ranks models by resolution rate, harness, release date, time, tokens and cost. The top entry, claude-fable-5-1 (max) with claude-code, reaches a 60.6% resolution rate at 38.6h, 97.9M tokens and $404.3, while the lowest listed, kimi-k3.1-pro (high) with terminus-2, reaches 19.1%.
Source: Hacker News AI · cloudopsbench.ai