Google and Meta open-source TorchTPU for native PyTorch on TPUs
At PyTorch Conference North America 2026 in San Jose, Google and Meta open-sourced TorchTPU, a native PyTorch backend for Tensor Processing Units. Meta plans to move larger-scale LLM workloads onto TPUs, and four repositories were released, including vLLM-TorchTPU and SGLang-TorchTPU.
- TorchTPU replaces PyTorch/XLA and needs only model.to("tpu") instead of model.to("cuda")
- Qwen3 235B MoE ran on 8,192 TPU v7x chips at 28% model FLOPs utilization
- TorchTPU, vLLM-TorchTPU, SGLang-TorchTPU and TorchTitan were open sourced
- AWS released a similar TorchNeuron backend for Trainium in public beta
Read next
AI