Hacker News AI· aestetix·· 15 hr agoAI score60
Teaching PacketSnitch to Use Its Own Documentation: Build a Small AI Tool Router
Teaching PacketSnitch to Use Its Own Documentation: Build a Small AI Tool Router
AI summary
The PacketSnitch developer describes routing natural-language requests to application actions by having a small model classify intent and look up pregenerated documentation rather than memorizing every function. A 0.5B Qwen2.5 router handles simple requests, with application-controlled escalation to a 1.5B model when intent or JSON validation fails. The author reports roughly $40 in training compute and a 153ms example response for a TCP filter request.
Source: Hacker News AI · packetsnitch.com