Local AI app that runs an 80B model on an 8GB Mac

A local AI app called Yanah claims to run an 80B-parameter model on an 8GB Mac at chat speed, keeping data private with no cloud, subscriptions, or internet needed to chat. The post explains that models store learned patterns as parameters in a file rather than the internet, and that a capable AI can fit in under 50 gigabytes.