Skip to main content
daily-triage/api-pods-fail-readiness-after-service-account-change.md
Daily Triage Briefing

API Pods Fail Readiness After a Service Account Change

Impact Summary

A fictional Kubernetes workload loses readiness after a service account change. Diagnose the bounded failure using read-only evidence, then escalate for controlled recovery.

SeveritySEV-3
StatusResolved simulation
PlatformKubernetes & Containers
Incident TypeKubernetes & Containers
Published28 Aug 2026
Technologies Involved
Kubernetes

Simulation Label

Fictional simulation. This exercise is a bounded, invented training scenario for practising operational reasoning. No real organisation, incident, telemetry, credentials or production identifiers are involved or implied.

Operational Summary

Root Cause

In the fictional reveal, a RoleBinding retained the previous service account subject after the Deployment adopted a dedicated service account.

Detection Method

Evidence-led guided investigation

Current Status

Resolved simulation

Affected Services

Kubernetes

Incident Overview

At 09:20, a fictional platform team reports that newly created catalogue-api pods remain unready in an isolated Kubernetes validation cluster. Existing pods still serve requests, so the simulated impact is degraded deployment capacity rather than a complete outage.

The difficulty began after a planned change assigned a dedicated service account to the Deployment.The team has confirmed neither the Kubernetes version nor the authorisation configuration. Operators have read access to the namespace but cannot apply changes.

The immediate objective is therefore to identify the strongest supported hypothesis, preserve the remaining healthy replicas and prepare a bounded recovery proposal for an authorised reviewer.

Investigation Options

Review the available operational moves and select the best immediate action.

A

Inspect the pod's service account, relevant RoleBindings and effective authorisation with read-only queries, while leaving healthy replicas untouched.

B

Collect node conditions and recent node events first, because a scheduling or host-capacity problem may explain the failed readiness probe.

C

Inspect Service selectors and endpoint membership first, because traffic routing could explain why users see degraded responses.

D

Escalate immediately without gathering more evidence, preserving the current workload exactly as it is.

Tags:Kubernetes