Edge0-145B: Frontier AI Capabilities on Your Own Computer
Edge0-145B: Frontier AI Capabilities on Your Own Computer
The company open-sourced Edge0-145B and Edge0-120B, describing Edge0-145B as the first open-source 145-billion-parameter on-device model, alongside a unified inference framework and deployment tools. It reports 29GB peak memory, 80+ tokens/s decoding, 1,100+ tokens/s prefill, roughly 120W typical power and 128K–256K context on a compatible laptop, with benchmark scores compared against named cloud models. The release also describes shared-matrix sparse experts, tiered GPU/system-memory/SSD loading and CPU-GPU co-scheduling, plus local demonstrations in video, Blender 3D scenes, games, drone control and PCB design.
It offers a detailed, benchmark-backed look at how a 100B+ model is engineered to run locally, useful for readers weighing on-device versus cloud AI.
Source: Hacker News AI · edge0.ai