Skip to main content
Kubernetes · Incident shift handover

Kubernetes Incident Handover Template

A structured Kubernetes incident handover for preserving scope, cluster state, evidence, mitigations, unsafe actions and the next operator decision across shifts or teams.

Choose the right control

Use this template when

  • A Kubernetes incident crosses a shift, team or escalation boundary.
  • The active response contains mitigations or partial recovery that the next operator must not repeat blindly.

Use another workflow when

  • The incident is resolved, validated and ready for a post-incident review.
  • A new responder only needs a short paging summary and no operational control is transferring.

Before you start

Collect these inputs before review so unchecked controls become evidence-backed decisions rather than placeholders.

A named incident channel and commander
The exact cluster, namespace and affected workload identifiers
A shared evidence location accessible to the receiving team

How to use this template

1

Create the handover before the outgoing operator leaves the incident.

2

Use absolute timestamps, cluster contexts and resource identifiers.

3

Separate observed facts from hypotheses and proposed actions.

Copyable template
# Kubernetes incident handover

## Incident control
- Incident ID:
- Severity and customer impact:
- Commander and current operator:
- Handover from / to:
- Handover time in UTC:
- Incident channel and evidence location:

## Exact scope
- Cluster and context:
- Region / environment:
- Namespaces and workloads:
- Affected versions or deployment revisions:
- Dependencies currently implicated:

## Current state
- Confirmed healthy components:
- Confirmed failed or degraded components:
- Last known-good timestamp:
- Current traffic, error and saturation signals:
- Recovery or mitigation currently in effect:

## Evidence retained
- Kubernetes events and timestamps:
- Pod, node and controller observations:
- Relevant logs, metrics and traces:
- Recent deployments or infrastructure changes:

## Actions already taken
- Command or change:
- Operator and timestamp:
- Observed result:
- Was it reverted or left in place?:

## Decision boundary
- Confirmed facts:
- Active hypotheses:
- Actions that must not be repeated:
- Unsafe actions or unavailable rollback paths:
- Next validation step and expected signal:
- Escalation or rollback trigger:

## Ownership acknowledgement
- Receiving operator:
- Questions resolved before transfer:
- Accepted at UTC:
- Next update due:

Evidence to retain

Review record

  • Timestamped workload, event and node observations
  • Commands already run with their outcomes
  • Current mitigation state, dashboards and relevant change records

Definition of done

Acceptance criteria

  • The receiving operator can state the current impact and next safe decision.
  • Completed and prohibited actions are unambiguous.
  • Ownership transfer is acknowledged with a timestamp.
Worked adaptation

Apply it to a real change

An API remains degraded after pods were rescheduled away from a failing node pool. A second region is healthy, but a database latency hypothesis remains unproven when the on-call shift changes.

  • Record the affected context, namespace and deployment revision.
  • Separate the confirmed node-pool symptom from the database hypothesis.
  • Name the next validation step and the condition that would trigger rollback.

Related KBY resources

Engineering signal

Follow Kubernetes failures and fixes

A useful digest about twice a week with new error references, tools, integration notes and production lessons. No daily noise.