ExecuTorch WebGPU: PyTorch Models on the GPU, in the Browser
ExecuTorch WebGPU: PyTorch Models on the GPU, in the Browser
ExecuTorch's new WebGPU backend runs PyTorch models exported with torch.export to a .pte file directly on the GPU in WebGPU-enabled browsers, without converting to another framework's format. The same artifact runs across Chrome and Safari on Metal, Vulkan and D3D12, and on an Apple M1 Pro in Chrome it was 4–7× faster than ExecuTorch's Wasm (XNNPACK) CPU path on prefill and 2–10× faster on decode. Validated models include Llama 3.2, Qwen3, Gemma 3, SmolVLM, Depth Anything V2, SAM 2, Whisper and on-device LoRA fine-tuning, all running locally in the tab.
It documents a concrete path for running PyTorch models on browser GPUs with benchmark numbers and a list of validated models, useful for developers weighing in-browser inference.
Source: PyTorch Blog · pytorch.org