Optimizing Muse Spark Open on TPU v7 with SGLang-TorchTPU
Optimizing Muse Spark Open on TPU v7 with SGLang-TorchTPU
The post describes ExecuTorch's new WebGPU backend, which lets PyTorch models exported once to a .pte file via torch.export run in any WebGPU-enabled browser through a WebAssembly runtime, covering LLMs, vision-language, segmentation, depth, detection, super-resolution, speech-to-text and on-device LoRA/DiReFT fine-tuning. On an Apple M1 Pro in Chrome, WebGPU was 4–7× faster than ExecuTorch's Wasm/XNNPACK CPU path on prefill and 2–10× faster on decode, with all data staying on the device. The backend is still in early development, and the post links an ExecuTorch WebGPU Playground and Hugging Face repos with .pte files and export recipes.
Featured coverage of this story: 《ExecuTorch WebGPU: PyTorch Models on the GPU, in the Browser》
Source: PyTorch Blog · pytorch.org