Software Language Barrier in AI Chip TPU Wars

Software Language Barrier in AI Chip TPU Wars

Because Nvidia's CUDA software is the industry standard, most AI models are written to run on it. To run on Google TPUs, engineers must translate their models using different software frameworks like JAX or XLA, a highly complex engineering task that has historically prevented rivals from leaving Nvidia.

Chapter 1

The silicon crown and how GPUs conquered the world

Chapter 2

The specialized challenger and the rise of the TPU

Chapter 3

The seismic shift and OpenAI's shopping spree

Chapter 4

The global chip chess board

Ch 2 · The specialized challenger and the rise of the TPU
steve

steve AI engineers struggle to switch hardware because translating code to run outside of Nvidia's CUDA is highly complex.

Oct 30

steve

steve Google started selling its powerful artificial intelligence chips to rival networks like Oracle.

Oct 30

steve

steve Google built custom processors in 2013 to prevent voice search from overwhelming its global data centers.

Oct 30

steve
The Great Chip Flip
BETA

steve Flip Google chips to OpenAI to discover how this deal changes who powers AI.

Oct 30

steve

steve Google TPU Eighth Generation

Separate chips, separate chips, One to train and one to think.

Oct 30

steve
Built from scratch for a single job

steve In 2015, Google introduced the TPU, bypassing general GPU video game tasks to focus entirely on matrix multiplication for deep learning.

Oct 30

steve
Quiz

What does the acronym TPU stand for in the context of computer hardware?

Oct 30

steve
Quiz

What mathematical operation is a TPU specifically optimized to perform at lightning speed?

Oct 30

steve
To excel at a single task, we must strip away the ability to do anything else.

Oct 30

steve
Google's decade of secret silicon

steve OpenAI buying Google's custom TPUs shifts the balance of power in artificial intelligence.

Oct 30

steve
Quiz

In what year did Google publicly reveal its first-generation Tensor Processing Unit?

Oct 30

steve
Quiz

What realization in 2013 prompted Google to start designing its own custom AI chips?

Oct 30

steve
Fun Fact

AlphaGo's brain: When Google's AlphaGo defeated world champion Lee Sedol at the game of Go in 2016, it was powered by Google's early, custom-built TPUs.

Oct 30

steve
Quiz

Why is switching from Nvidia GPUs to Google TPUs a difficult task for software engineers?

Oct 30

steve
Quiz

Which Google-backed software framework is commonly used to program and run models on TPUs?

Oct 30

steve
Glossary
tensor processing unit (noun)
A specialized integrated circuit designed to accelerate machine learning and neural network calculations. OpenAI began renting these custom chips in June 2025 before planning a direct hardware purchase.

Oct 30

steve
Quiz

What do the 't' and 'i' stand for in Google's 8th-generation TPU models (8t and 8i)?

Oct 30

steve
Quiz

Which generation of Google's Tensor Processing Units was released for public cloud deployment in late 2026?

Oct 30

steve
Gossip

Would you trust a self-driving car powered by Google chips?

Oct 30