iCreatAI News
Skip to content
Hacker News AI· kingsotn·· 13 hr agoAI score58

Show HN: Portal2Bench – Can AI agents solve Portal 2?

Show HN: Portal2Bench – Can AI agents solve Portal 2?

AI summary

Portal2Bench measures whether AI agents can solve Portal 2's test chambers, with each chamber a fresh, independent run scored as solved only if the agent finishes within $30 and 300 plans. In the reported results, GPT-6.1 Sol (Codex) and GPT-6 Astra (Codex) each solve 20 of 26 chambers, GPT-6.1 Terra 19, Opus 5.5 11, Sonnet 5.5 6, GPT-6 Luna 0, and Fable 5.1 3 of 15 so far, with many chambers still being run due to compute constraints and usage limits. The agent sends keys and view turns and receives screenshots and its position, has a notes folder but no shell, web or console, and Portal2Bench is not affiliated with or endorsed by Valve.

Source: Hacker News AI · kingstonyip.com