Hacker News AI· designervoid·· 2 days agoAI score50
On-device AI: new knowledge without fine-tuning
On-device AI: new knowledge without fine-tuning
AI summary
Viper describes its Mac AI chat that runs an unchanged open model (gpt-oss-20b) entirely on-device, teaching it about the app through a harness of guides, question splitting and code checks rather than fine-tuning. On 167 fresh blind-judged questions, the harness improved correct answers from 2% (model alone) to 41% (1.5.34) and 61% (1.5.35), while invented answers fell from 57% to 24% and 4%. It requires an Apple silicon Mac with about 24 GB of memory, and the 1.5.35 figures come from the test bench, not yet an app build.
Source: Hacker News AI · github.com