Skip to content

Guide · Agent skill

How to use the Troubleshoot GKE TPU VMs in Repair agent skill

Updated · written with AI from the project's own documentation and checked against our catalogue data

This guide explains how to install and use the Troubleshoot GKE TPU VMs in Repair agent skill, a set of instructions that lets an AI agent investigate Google Kubernetes Engine TPU machines stuck in the Compute Engine REPAIRING state. It is written for people who have never used agent skills before. By the end you will know what the skill does, how to add it to Claude, how to phrase a request that triggers it, and what you need in place before it can run.

Troubleshoot GKE TPU VMs in Repairgoogle/skills · Apache-2.0

Quick start

  1. 1Download the ZIP. Download the skill ZIP from this page and unzip it. You should see a folder named gke-ai-troubleshooting-tpu-vm-repair-stuck with SKILL.md inside.
  2. 2Place the folder. Move the folder into ~/.claude/skills/ for a personal install, or into your project's .claude/skills/ folder to limit it to one project.
  3. 3Or upload it in the apps. In the Claude apps, open Settings, go to Capabilities, then Skills, and upload the skill.
  4. 4Check prerequisites. Confirm gcloud, kubectl and the required plugins are installed, your project has billing enabled, and your account has the three viewer roles.
  5. 5Ask in plain language. Describe the symptom, such as a TPU VM stuck in REPAIRING or unschedulable slice workloads, and give your project, cluster and node pool details.
  6. 6Review the findings. Read the agent's summary of VM status, host events and GKE repair status, and follow the linked documentation for any fix.

What the skill makes the agent do

When installed, the agent gets a step-by-step troubleshooting guide for GKE TPU machines that are stuck in a REPAIRING state after hardware host errors, maintenance events, or faulty host reports. The agent checks the VM status, host events in audit logs, and GKE repair status, using read-only commands only.

  • Checks the VM status of the TPU instances in the affected node pool.
  • Reads host events in Cloud Audit Logs.
  • Checks GKE repair status.
  • Points you to the relevant Google documentation for fixes.
  • Routes you to other skills when the problem is a different node or pod issue.

Install the skill from the ZIP file

Download the ZIP file for the skill from this page and unzip it. Agent skills are folders containing a SKILL.md file and supporting files. The skill folder is named gke-ai-troubleshooting-tpu-vm-repair-stuck and contains SKILL.md and references/attribution.md.

For a personal install that works in every project, unzip the folder into ~/.claude/skills/. To limit it to one project, unzip it into that project's .claude/skills/ folder instead.

If you use the Claude apps rather than a terminal, upload the skill under Settings → Capabilities → Skills.

Trigger the skill with a natural request

You do not need to type the skill name. The agent loads the skill when your request matches its description. The skill is designed for cases where TPU instances in a slice node pool remain in REPAIRING, host error events appear in audit logs, or TPU slices are unschedulable because a VM is in repair.

Describe the symptom in plain words and include your cluster details if you have them, such as the project, cluster, location, and node pool name.

  • My TPU slice node pool has a VM stuck in REPAIRING after a host error. Can you check it?
  • Our multi-host TPU workloads are unschedulable and I see host error events in the audit logs.
  • Some TPU instances in our All Capacity mode node pool have been repairing for hours. What is going on?

What to provide the agent

The agent first collects context before running any checks. It needs the project ID, cluster name, cluster location, cluster mode (Autopilot or Standard), TPU version, and the TPU node pool name. For Standard clusters it reads the node pool's instance group details. For Autopilot clusters, or when the node pool name is unknown, it uses the MIG listing steps from the Google documentation.

  • {project_id}, {cluster_name}, {location}, {cluster_mode}, {tpu_version}, {nodepool_name}
  • Whether the node pool is single-host or multi-host

Safety: scripts, network and permissions

This skill runs scripts and uses the network. It runs read-only diagnostic commands and is forbidden from draining, deleting, re-creating nodes, or running any other command that changes the cluster. Fixes are given to you to apply yourself.

Every gcloud command the agent runs is tagged with an attribution environment variable that identifies the skill and its version. The tag contains no user data, and the skill says not to use gcloud config set for it so the tag does not persist.

  • Required IAM roles: Kubernetes Engine Viewer, Compute Viewer, and Logs Viewer.
  • Cluster Admin is only needed by the user who enables node auto-repair.
  • The project needs active billing and the Kubernetes Engine, Compute Engine, and Cloud Logging APIs enabled.
  • Required tools: the gcloud CLI and kubectl with its required plugins.

Tips for getting useful results

Have your tools and access ready before you start, so the agent's checks are not blocked. Use the skill for the specific symptom it covers. If your nodes show Ready: Unknown and no VM is in REPAIRING, the skill directs you to other troubleshooting skills instead.

  • Confirm gcloud and kubectl work for your project before asking.
  • Keep the node pool name handy; it saves a discovery step.
  • If the agent recommends a fix, follow the linked documentation section it cites.

What people use it for

  • Finding out why a multi-host TPU slice node pool is unschedulable after a host error.
  • Checking audit logs for host error or maintenance events on TPU VMs in an All Capacity mode node pool.
  • Confirming whether a TPU node is in GKE repair or stuck in REPAIRING before escalating to support.
  • Getting pointed to the right documentation section for a faulty host report on TPU nodes.

Frequently asked questions

How do I install the Troubleshoot GKE TPU VMs in Repair skill?

Download the ZIP from this page and unzip it. For a personal install, place the gke-ai-troubleshooting-tpu-vm-repair-stuck folder in ~/.claude/skills/, or in a project's .claude/skills/ folder for one project. In the Claude apps, you can upload it under Settings, then Capabilities, then Skills.

What do I need to run this skill?

You need the gcloud CLI and kubectl with required plugins, a Google Cloud project with active billing, and the Kubernetes Engine, Compute Engine and Cloud Logging APIs enabled. Your account needs the Kubernetes Engine Viewer, Compute Viewer and Logs Viewer roles.

Is this skill free?

The skill is licensed under Apache-2.0. Google Cloud usage, such as the APIs and tools it calls, is governed by your own Google Cloud account and its billing.

Will the agent fix my TPU nodes automatically?

No. The skill is read-only. It is forbidden from draining, deleting, re-creating nodes or changing the cluster, and it gives you the fix to apply yourself with a link to the relevant documentation.

What if my nodes show Ready: Unknown and no VM is in REPAIRING?

This skill is not the right one for that case. The skill says to use the gke-ai-troubleshooting-node-unresponsive-timeout skill for Ready: Unknown nodes with no VM in REPAIRING, and the gke-node-notready skill for other NotReady nodes.

How does this compare with other troubleshooting skills?

This skill focuses on TPU VMs in Compute Engine REPAIRING state. The source says to use other skills for Pending pods when all nodes are Ready, JobSet preemption events, and Slice custom resource lifecycle failures.

New agent skills, repos and AI tools — every week

The best new skills and open-source projects, the fastest-growing repos, and one free prompt. Five minutes to read. Unsubscribe anytime.

Our verdict

Use this skill if you run TPU slice node pools on GKE and need a read-only, documented way to see why a VM is stuck in REPAIRING. Pick something else if your nodes are NotReady without a VM in repair, you are not running GKE TPU workloads, or you want an agent that applies fixes for you.

Download the skill