Kubernetes Incident Handover Template
A structured Kubernetes incident handover for preserving scope, cluster state, evidence, mitigations, unsafe actions and the next operator decision across shifts or teams.
Choose the right control
Use this template when
- A Kubernetes incident crosses a shift, team or escalation boundary.
- The active response contains mitigations or partial recovery that the next operator must not repeat blindly.
Use another workflow when
- The incident is resolved, validated and ready for a post-incident review.
- A new responder only needs a short paging summary and no operational control is transferring.
Before you start
Collect these inputs before review so unchecked controls become evidence-backed decisions rather than placeholders.
How to use this template
Create the handover before the outgoing operator leaves the incident.
Use absolute timestamps, cluster contexts and resource identifiers.
Separate observed facts from hypotheses and proposed actions.
# Kubernetes incident handover ## Incident control - Incident ID: - Severity and customer impact: - Commander and current operator: - Handover from / to: - Handover time in UTC: - Incident channel and evidence location: ## Exact scope - Cluster and context: - Region / environment: - Namespaces and workloads: - Affected versions or deployment revisions: - Dependencies currently implicated: ## Current state - Confirmed healthy components: - Confirmed failed or degraded components: - Last known-good timestamp: - Current traffic, error and saturation signals: - Recovery or mitigation currently in effect: ## Evidence retained - Kubernetes events and timestamps: - Pod, node and controller observations: - Relevant logs, metrics and traces: - Recent deployments or infrastructure changes: ## Actions already taken - Command or change: - Operator and timestamp: - Observed result: - Was it reverted or left in place?: ## Decision boundary - Confirmed facts: - Active hypotheses: - Actions that must not be repeated: - Unsafe actions or unavailable rollback paths: - Next validation step and expected signal: - Escalation or rollback trigger: ## Ownership acknowledgement - Receiving operator: - Questions resolved before transfer: - Accepted at UTC: - Next update due:
Evidence to retain
Review record
- Timestamped workload, event and node observations
- Commands already run with their outcomes
- Current mitigation state, dashboards and relevant change records
Definition of done
Acceptance criteria
- The receiving operator can state the current impact and next safe decision.
- Completed and prohibited actions are unambiguous.
- Ownership transfer is acknowledged with a timestamp.
Apply it to a real change
An API remains degraded after pods were rescheduled away from a failing node pool. A second region is healthy, but a database latency hypothesis remains unproven when the on-call shift changes.
- Record the affected context, namespace and deployment revision.
- Separate the confirmed node-pool symptom from the database hypothesis.
- Name the next validation step and the condition that would trigger rollback.
Related KBY resources
Follow Kubernetes failures and fixes
A useful digest about twice a week with new error references, tools, integration notes and production lessons. No daily noise.