iCreatAI News
Skip to content
Hacker News AI· mikeamm·· 1 days agoAI score60

Benchmarks for document tasks for local AI models

Benchmarks for document tasks for local AI models

AI summary

DocBlocks added support for local models to power document features and created "docbench," a 100-point weighted benchmark scoring 24 local models (0.8B to 35B parameters) on review, writing, diagrams, slides, study aids and transcript cleanup, with Qwen 3.8 27B Q4 leading at 81 and Gemma 4 12B statistically level at 79. Cloud models scored 87–91, at least 6 points above the best local model, and review separated models most: large models find real problems while 1–2B models pad reviews with trivial or wrong suggestions. The post recommends picking the highest-scoring model your machine can hold, calling Gemma 4 12B the sweet spot.

Source: Hacker News AI · bendyline.com