Advancing the Quality-Efficiency Frontier for Coding AI on Windows PCs

Microsoft describes MAI-Code-1.1-Flash, a 137.9-billion-parameter mixture-of-experts coding model quantized from roughly 276 GB at 16-bit precision to a 53.0 GiB mixed-precision checkpoint (with a 46.1 GiB variant), running locally on NVIDIA RTX Spark PCs via GitHub Copilot. Using a DFlash2 speculative-decoding draft with layer-wise sliding-window attention, the measured RTX Spark configuration reached a median 51.12 tokens per second at 120K-token input context, with median end-to-end latency falling 27% from 527.25 to 382.41 seconds.