How to Run NVIDIA Dory 4B with llama.cpp: Loop by Loop Guide

This tutorial builds the llama.cpp fork pinned by NVIDIA's model card, downloads the 3.7 GB Q5_K_M GGUF for Dory 1.0 4B, and reads the GGUF header to predict the parameter and KV-cache cost of each loop count. It then starts llama-server at one to four loops in both per_loop and last_loop cache modes, checks the measured KV memory against predictions, measures decode speed, and runs correctness gates plus a paired GSM8K evaluation.