Genie with Genie Ontology Delivers 1.6× the Accuracy with Less than Half the Tokens

Databricks developed a new enterprise data-agent benchmark with Turing, run in a live Databricks workspace, in which Genie achieved a 91% pass rate versus 45% and 58% for two frontier agents while using fewer than half the tokens and completing tasks 3–4x faster. The benchmark, built around a fictional UK energy supplier called Calderwick Energy, includes notebooks, dashboards, saved SQL queries and documents alongside hundreds of tables, testing whether agents can find and use business context that table schemas alone cannot provide. Genie Ontology, now generally available, automatically extracts and organizes this knowledge and surfaces relevant context for Genie.