The Sweet Spot: How One Brain and Thousands of Micro-Adapters Could Save Open AI

The article argues that open models are bottlenecked by hardware because Mixture of Experts architectures must keep all total parameters in memory even though only a fraction are active per token. It proposes a frozen, quantized base model paired with thousands of 2–5 MB low-rank adapters selected by a two-step hierarchical router, plus Multi-Head Latent Attention to compress the context cache by roughly ninety percent. Because small adapters can be streamed from system RAM or SSD in a millisecond or two, the design lets capable AI run locally on accessible hardware instead of multi-GPU clusters.