iCreatAI News
Skip to content
PyTorch Blog· Haolin Fu, Xiaoyu Zhang, Junyan Xu, Wangyuan Zhang, Haoguang Cai, RadixArk Team·· 4 days agoSame storyAI score70

Optimizing Muse Spark Open on TPU v7 with SGLang-TorchTPU

Optimizing Muse Spark Open on TPU v7 with SGLang-TorchTPU

AI summary

The post describes ExecuTorch's new WebGPU backend, which lets PyTorch models exported once to a .pte file via torch.export run in any WebGPU-enabled browser through a WebAssembly runtime, covering LLMs, vision-language, segmentation, depth, detection, super-resolution, speech-to-text and on-device LoRA/DiReFT fine-tuning. On an Apple M1 Pro in Chrome, WebGPU was 4–7× faster than ExecuTorch's Wasm/XNNPACK CPU path on prefill and 2–10× faster on decode, with all data staying on the device. The backend is still in early development, and the post links an ExecuTorch WebGPU Playground and Hugging Face repos with .pte files and export recipes.

Featured coverage of this story: 《ExecuTorch WebGPU: PyTorch Models on the GPU, in the Browser》

Source: PyTorch Blog · pytorch.org