← Field notes

Google Open-Sources TorchTPU: Native PyTorch on Google TPUs

Google has announced TorchTPU, its native PyTorch stack for Google's TPUs, and made it available as open source on GitHub. The announcement was dated October 20, 2026, and Google says it was made at the PyTorch Conference 2026. The official write-up, TorchTPU is now open source: Run native PyTorch on TPUs, is credited to Mark Lohmeyer, VP and GM of AI and Computing Infrastructure, and Bill Jia, Vice President of Engineering. TechCrunch covered the same launch the same day in its report on Google's push into AI app development.

What it actually does

The pitch is simple. TorchTPU lets teams run standard PyTorch APIs on TPUs as a native option, joining GPUs and CPUs, with eager mode and torch.compile supported. Google says moving to it takes minimal code changes. The company also says the stack was co-developed with the PyTorch team at Meta, so this is not a Google side project bolted onto someone else's framework.

Google's post also names a TPU agent suite that is currently in preview and says LiteRT now joins the PyTorch ecosystem. Those pieces are secondary to the core news, but they show Google is trying to cover more of the stack than just the training kernel.

What is not stated

Read the primary post and the TechCrunch story closely and you will notice what is missing. Neither piece states a specific license beyond "open source," gives an availability date beyond "now," or lists pricing for running workloads on TPUs. TechCrunch describes the switch as a simple configuration change, while Google's own wording is minimal code changes. Those are not the same claim. If you are planning a port, cite Google's version, and test the rest yourself.

What it means for solo operators and marketers

Most of us will never train a frontier model. We run inference, fine-tune smaller models for client work, and rent compute from whoever is cheapest this quarter. For that crowd, TorchTPU matters for one reason: it adds a second hardware option without forcing a rewrite of the PyTorch code your team already knows.

The partner quotes in Google's post point the same way. Meta's PyTorch engineering director, Hugging Face's product VP, and leaders from Anyscale and Inferact are all cited on support for the tools many of us already touch, including Transformers, Ray and vLLM. If your agency runs client models or analytics pipelines on whatever GPU your vendor happens to have, a second supply path is worth knowing about before you need it.

Our take

This is the most useful kind of AI news: the plumbing kind. Google did not announce a model you can screenshot. It opened a compatibility layer that makes its hardware less of a special case for PyTorch developers. Having co-founded Urchin, which became Google Analytics, I have a soft spot for Google shipping boring infrastructure that people actually depend on. Open-sourcing the stack is a smart move against the default GPU position, because lock-in gets cheaper to break when the switching cost is a configuration change.

Our advice is to put TorchTPU on a test branch this week, run one real workload, and measure cost and latency against your current setup. Do not take anyone's word for it, including ours. Until the license and pricing are spelled out in writing, treat this as a serious option, not a switch to flip on a Friday afternoon.

Book a 30-min discovery →