iCreatAI News
Skip to content
Trending storyUpdating

Databricks research: Genie One accuracy reaches up to 95%

1 reports1 sources16 hr agoUpdated

Understand this story

AI overview

Databricks releases a Genie One accuracy study, tested with a fictional commercial auto insurance company: using only data tables, Genie One's accuracy was 64%; adding curated Agents or a governance layer each brought accuracy to 83%; combining both raised accuracy to 93–95%. Databricks says Genie One is powered by the generally available (GA) Genie Ontology, which brings business context into the analytics experience. The study examines another aspect of Genie Ontology and is different from the Turing benchmark in the Genie Ontology GA announcement.

AI overview based on source reports · Updated 14 hr ago

Coverage timeline

Follow the coverage to explore different perspectives.

Nov 20
  1. Databricks Blog
    Genie One Accuracy: Why Curated Agents Need Governed Context

    A Databricks study of Genie One found that tables alone scored 64% on a 125-question insurance benchmark, while curated agents and a governed layer (certified Metric Views, Domains, Subdomains, and Pages in Unity Catalog) each reached 83%, and combining both reached 93–95%. The governed layer fixed definition questions (100%) and reduced reliance on unrelated Pages and decoy tables, while agents remained the route to team documents; a fictional retailer test showed the governed layer raising accuracy from 54% to 82%.

Activity for this story

Current comparable activity
7
Peak comparable activity
10Nov 20 06:00
Change in the past 24 hours
–

Trends compare the same fully observed participants, which may cover fewer participants than current activity. Move the pointer or tap the chart to inspect hourly activity; use the left and right arrow keys with a keyboard.