Back to all scenarios
Scenario #320
Storage
Kubernetes v1.25, AWS EBS
Zombie Volumes Occupying Cloud Quota
Deleted PVCs didn’t release volumes due to failed detach steps, leading to quota exhaustion.
Find this helpful?
What Happened
PVCs were deleted, but EBS volumes stayed in-use, blocking provisioning of new ones due to quota limits.
Diagnosis Steps
- 1Checked AWS Console: volumes remained.
- 2Described events: detach errors during node crash.
Root Cause
CSI driver missed final detach due to abrupt node termination.
Fix/Workaround
• Manually detached and deleted volumes.
• Adjusted controller retry limits.
Lessons Learned
Cloud volumes may silently linger even after PVC/PV deletion.
How to Avoid
- 1Use cloud resource monitoring.
- 2Add alerts for orphaned volumes.