Products & Tools

Google Cloud makes Pathways generally available on GKE

Google Cloud says Cloud Pathways processed 130 million TPU chip-hours in 90 days. The GKE runtime is generally available, while a Slurm integration remains in Preview.

Google Cloud Makes Pathways Runtime GA for Large-Scale TPU Workloads
Google Cloud Makes Pathways Runtime GA for Large-Scale TPU Workloadsfrabre / pixabay
By James Calloway5 min read

Why it matters

  • Cloud Pathways became generally available on GKE on November 9, 2026.
  • Google says users processed more than 130 million Cloud TPU chip-hours in the preceding 90 days.
  • An unnamed consumer technology customer uses tens of thousands of TPUs and more than 100 million chip-hours per quarter.
  • ZenteiQ uses Cloud Pathways with Cluster Toolkit, sidecars, host snapshotting, MaxText and Tunix.
  • GKE support covers TPU v5e, v5p, Trillium TPU v6e and Ironwood TPU 7x with JAX 0.10.1 or later; the Slurm integration remains in Preview.

Google Cloud said users processed more than 130 million Cloud TPU chip-hours with Cloud Pathways on Google Kubernetes Engine (GKE) during the 90 days before its November 9, 2026 general-availability announcement. Google did not disclose how many customers produced those hours or what they cost per unit of work.

By James Calloway

What did Google Cloud release on November 9?

Google Cloud announced that Cloud Pathways, also called Pathways on Cloud, is generally available on GKE. The runtime, or software layer that coordinates and executes AI workloads, gives customers one controller for large-scale training and inference.

As a core runtime pillar of Google Cloud AI Hypercomputer, Pathways sits within Google's large-computing stack. Google DeepMind originally engineered it to train and serve Google's frontier models, including Gemini.

Google says the software targets massive fleets of heterogeneous accelerators, meaning chip types or configurations that differ within one workload. The release extends technology used for Google's largest AI workloads to Cloud customers.

Takeaway: Google has placed infrastructure for its own frontier-model workloads on GKE, without publishing an equivalent model-performance benchmark.

Which customers are already using it?

Google Cloud reports that a large consumer technology company runs production batch jobs and reinforcement-learning inference, using reward signals to guide model actions, on tens of thousands of TPU v5p, Trillium v6e and Ironwood TPU7x chips. The company remains unnamed.

Its deployment consumes more than 100 million chip-hours per quarter. The customer also co-designed elasticity primitives with Google, meaning controls that resize distributed work, as it expands into pre-training, or initial model training.

Google's report supplies no model-quality, utilization or cost metrics. A chip-hour counts one TPU operating for one hour; it does not reveal training speed or completed jobs.

ZenteiQ applies the same stack to scientific foundation models, or general-purpose models intended for scientific work. It uses Cloud Pathways on GKE with Cluster Toolkit, colocated sidecars and host snapshotting for elastic MaxText pre-training.

ZenteiQ also runs single-controller reinforcement learning with MaxText and Tunix across multi-slice Trillium clusters. Founder Sashikumaar Ganesan said the controller monitors TPU topology, meaning the arrangement of chips, and dynamically re-meshes and resizes workloads when a chip or slice goes offline.

He said: “Combining Pathways with host snapshotting in production pushes recovery time down to a minimum when disruptions occur, keeping our available TPU capacity fully utilized with very little stall time,” he said. The announcement gives no measured recovery time or stall percentage for that deployment.

Takeaway: The reported deployments show operational reach, but they do not quantify better utilization or faster recovery.

How does one controller change JAX orchestration?

In the default multi-controller setup for JAX, Google's numerical-computing framework, every TPU host runs a separate Python interpreter and sees only its locally connected devices. All hosts execute the same single-program, multiple-data program in lockstep, synchronizing each batch across distributed workers.

According to Google, that arrangement becomes complex and brittle as jobs scale. It complicates heterogeneous multi-program workloads and resource management across TPU slices, which are groups of interconnected chips.

Cloud Pathways replaces those controllers with one unified controller built on the open-source Interim Framework Runtime. Setting JAX_PLATFORMS=proxy and using pathwaysutils lets one JAX client view and orchestrate multiple large slices, spanning thousands of chips, as if their devices were connected locally.

The controller manages graph evaluation, meaning execution of a model's computation graph. It also handles persistent compilation caching in Cloud Storage and asynchronous dispatch of XLA work across slices.

XLA is Google's compiler and execution layer for accelerator code. The announcement does not quantify the controller's overhead or compare it with default JAX coordination.

Takeaway: Pathways promises one coordination plane for many chip groups, but the announcement offers no throughput or cost comparison.

What do sidecars and elastic recovery add?

Google runs colocated Python sidecar containers on TPU hosts, where they share memory with compute-intensive tasks. The announcement says these sidecars handle distributed data loading and checkpointing, which saves model state during training.

Google does not quantify the sidecars' compute or memory overhead. That omission leaves their operating cost unclear for customers.

The system uses host-memory snapshots for elastic training, redistributing a job onto one fewer slice after a hardware interruption. This recovery design aims to keep the client running.

Interactive mode supports notebooks and terminals. Shared Pathways Service lets multiple users and jobs draw from a long-running pool of TPU slices.

Takeaway: Sidecars and snapshots reduce distinct forms of coordination work, but their measurable contribution remains undisclosed.

Where can customers use it?

Cloud Pathways is generally available on GKE in all Google Cloud regions that support Cloud TPU v5e, TPU v5p, Trillium TPU v6e and Ironwood TPU 7x. Google also provides versioned container images supporting JAX 0.10.1 and later.

The release defines its footprint by four listed TPU families and a specified JAX baseline. It makes no compatibility promise for older accelerator generations or unlisted framework releases.

A separate Cluster Director integration extends Cloud Pathways to Slurm TPU clusters. It supports unified multi-slice JAX execution, elastic training and interactive notebooks.

Slurm is a cluster workload manager, and Google describes this integration as Preview. That status is explicitly distinct from the GKE runtime's general availability.

The announcement states no pricing or service quotas. It also gives no preview exit timeline, leaving that integration on a less mature footing than GKE.

Takeaway: General availability covers specific GKE regions and TPU generations, while the Slurm route remains experimental.

What does this change for AI infrastructure?

Google Cloud positions Pathways for operators running multi-day jobs on high-cost accelerators. Its unified controller coordinates TPU slices, while snapshot-based recovery is designed to keep the client job alive after an individual slice fails.

Availability, rather than raw chip count, determines whether expensive distributed training finishes on schedule. Google's unified controller attacks the operational overhead between separate TPU hosts and slices.

Google's 130 million chip-hour figure indicates substantial use, but Google does not connect that volume to higher utilization or lower cost. ZenteiQ's scientific-model deployment broadens the use case beyond consumer and frontier-model training.

The release still lacks independent tests, model benchmarks, measured stall time and published cost savings. It also leaves the Slurm path in Preview, so general availability applies specifically to GKE.

Takeaway: The next proof point is comparative data showing whether one-controller orchestration improves recovery, utilization or cost under real multi-slice failures.

Source: unite.ai

Share this article:

More from James Calloway

James Calloway

Show full bio

News editor covering people, launches and day-to-day practice in artificial intelligence and machine learning at AI In Context.

446 articles

Related articles

  1. llm-d 1.0 arrives: Google's open inference stack cuts median TTFT 85%
  2. Google ships four TPU systems in one year to challenge Nvidia
  3. Google Unveils Gemini 4 Argon — but Only 'Trusted Cyber Defenders' Get It First
  4. Google’s new TPUs target secure, high-memory AI agents
  5. Google Open-Sources Harness²: Framework That Improves Agents Without Touching Model Weights

« Previous articleNext article »