iCreatAI News
Skip to content
Hacker News AI· garymiklos·· 2 days agoAI score40

iOS Simulator MCP benchmark: eight tools for AI agents

iOS Simulator MCP benchmark: eight tools for AI agents

AI summary

A benchmark on one Mac and one iPhone 17 Pro Simulator compared eight iOS Simulator tools for AI agents, each driven through its own MCP server (AXe via its command line), on a full sign-in flow. simulator-use 0.15.0 read 194 estimated tokens per sign-in, 3.4x fewer than the next tool, 66x fewer than Xcode MCP and 569x fewer than AXe, and was also fastest at 3.50 s step by step and 2.87 s batched. Every call was timed and saved, failures included, with a median of 10 runs per tool on a freshly started app.

Source: Hacker News AI · simulator-use.dev