iCreatAI News
Skip to content
Hacker News AI· anmejia·· 3 days agoAI score43

CloudOpsBench: AI benchmark shows FAI models struggling with cloud infra

CloudOpsBench: AI benchmark shows FAI models struggling with cloud infra

AI summary

CloudOpsBench is a benchmark for AI agents on real cloud operations, and its leaderboard ranks models by resolution rate, harness, release date, time, tokens and cost. The top entry, claude-fable-5-1 (max) with claude-code, reaches a 60.6% resolution rate at 38.6h, 97.9M tokens and $404.3, while the lowest listed, kimi-k3.1-pro (high) with terminus-2, reaches 19.1%.

Source: Hacker News AI · cloudopsbench.ai