iCreatAI News
Skip to content
Hacker News AI· fouadb66·· 1 hr agoAI score58

Tiny AI Security Model Beats Five Frontier LLMs on Privacy Detection

Tiny AI Security Model Beats Five Frontier LLMs on Privacy Detection

AI summary

ProofAgent Nano, a 98M-parameter on-device model, reports 0.935 average F2 on the full English PIIMB test set, ahead of 36 published models including OpenMed's 1.4B filter at 0.918. On a separate 2,000-sentence sample scored with the same PIIMB tool, Nano scored 0.933 versus 0.901 for Claude Fable 5.1 and 0.828 for Claude Haiku 5.5, though the full-set result was computed locally and not submitted to the public leaderboard. A multilingual version covers English, French and Arabic, and the model flags PII, prompt injection, jailbreaks and data exfiltration with mappings to 38 regulatory frameworks.

Source: Hacker News AI · proofagent.ai