Skip to main content
daily-triage/ready-pods-fail-through-stale-kubernetes-service-selector.md
Daily Triage Briefing

Ready Pods Fail Through a Stale Kubernetes Service Selector

Impact Summary

Diagnose a fictional Kubernetes Service that has ready application Pods but no matching endpoints, then choose a bounded recovery path without changing the cluster during triage.

SeveritySEV-3
StatusResolved simulation
PlatformKubernetes & Containers
Incident TypeKubernetes & Containers
Published7 Sept 2026
Technologies Involved
Kubernetes

Simulation Label

Fictional simulation. This exercise is a bounded, invented training scenario for practising operational reasoning. No real organisation, incident, telemetry, credentials or production identifiers are involved or implied.

Operational Summary

Root Cause

In the fictional scenario, the Service selector remains app=ledger-api while the Ready replacement Pods use app=ledger-api-v2, leaving the Service with no matching endpoints.

Detection Method

Evidence-led guided investigation

Current Status

Resolved simulation

Affected Services

Kubernetes

Incident Overview

A fictional internal application named ledger-api is unavailable through its Kubernetes Service after a routine deployment. Direct application health observations supplied by the exercise indicate that three replacement Pods are Ready.

The deployment reports its intended replica count as available, yet requests through the Service fail. The fictional impact is confined to one internal workflow, with no evidence of data loss or wider cluster failure.The incident lead asks for the safest immediate action.

No manifest change is authorised during this triage stage. Success means establishing whether the Service currently selects the replacement Pods, identifying an evidence-supported recovery candidate, and preserving a clear boundary for escalation.

Investigation Options

Review the available operational moves and select the best immediate action.

A

Inspect the Service selector, Pod labels and endpoint objects using read-only queries; if the mismatch is confirmed, prepare a reviewed correction without applying it.

B

Restart the Ready Pods to force endpoint registration.

C

Investigate cluster networking before comparing selectors and labels.

D

Send traffic directly to Pod addresses as a temporary operational bypass.

Tags:Kubernetes