Back to all scenarios
Scenario #137
Networking
K8s v1.19, GKE
Pod IP Conflict Causing Service Downtime
A pod IP conflict caused service downtime and application crashes.
Find this helpful?
What Happened
Two pods were assigned the same IP address by the CNI plugin, leading to network issues and service downtime.
Diagnosis Steps
- 1Investigated pod IP allocation and found a conflict between two pods.
- 2Checked CNI plugin logs and discovered a bug in IP allocation logic.
Root Cause
CNI plugin bug causing duplicate pod IPs.
Fix/Workaround
• Restarted the affected pods, which resolved the IP conflict.
• Reported the issue to the CNI plugin developers and applied a bug fix.Lessons Learned
Avoid relying on automatic IP allocation without proper checks.
How to Avoid
- 1Use a custom IP range and monitoring for pod IP allocation.
- 2Stay updated with CNI plugin releases and known bugs.