How We Built TLX: A Hardware-Native GPU Compiler for Production ML at Scale

Meta introduces Triton Low-Level Extensions (TLX), an extension to Triton that adds explicit warp-group and cluster-level orchestration so engineers can use modern GPU features like TMA, TMEM, and warp specialization while keeping Triton's programming model. TLX is in production across Meta workloads, with reported gains including 20-25% end-to-end MFU for GEM model training on thousands of NVIDIA Blackwell GPUs, up to two-thirds net-latency reduction in RecSys inference, and a distributed grouped GEMM kernel running in large-scale LLM pretraining. The post frames TLX as implementing a "MIMW" abstraction between CUDA's SIMT model and Triton's block-level model, and covers five extension areas: warp-group orchestration, synchronization, memory orchestration, cluster execution, and optional layouts.