Lowvram: A CLI tool to run large AI models in low VRAM GPUs

Henrique Soares introduces lowvram, a Linux CLI tool that intercepts CUDA calls via LD_PRELOAD, replacing cuMemAlloc with cuMemAllocManaged so applications can use system RAM when VRAM is insufficient. On a 6 GB RTX 3060, YuE2 under lowvram generated 43.1 tokens per second versus 1.9 for Accelerate and 6.8 for CPU, and Llama-TTS with Qwen3-TTS ran after a standard run failed with an out-of-memory error. The author notes trade-offs: PCIe paging slows computation, system RAM can be exhausted, and the tool requires CUDA knowledge.