PyTorch Blog· Caleb Min Sup Kim, Ethan Che, Jongsok Choi, Jason Ansel·· 2 days agoAI score38
Fast by Default: Compile-Time Heuristics for Helion Kernels
Fast by Default: Compile-Time Heuristics for Helion Kernels
AI summary
Helion now uses compile-time heuristics that analyze a kernel's IR and dataflow to classify it as matmul, reduction, or pointwise and emit block sizes, warps, and stages without autotuning. On H100, the computed configs reach 1.18x hand-written FLA Triton for linear attention, 1.27x vLLM's handwritten CUDA reduction kernels, and 1.09x torch.compile max-autotune on a general reduction suite. The heuristics are merged into Helion and enabled by default on H100 and B200 with the Triton backend.
Source: PyTorch Blog · pytorch.org