Back to all scenarios
Scenario #193
Networking
K8s v1.18, GKE
Pod Connectivity Loss After Network Plugin Upgrade
Pods lost connectivity after an upgrade of the Calico network plugin due to misconfigured IP pool settings.
Find this helpful?
What Happened
After upgrading the Calico CNI plugin, the IP pool configuration was not correctly migrated, which caused pods to lose connectivity to other pods and services.
Diagnosis Steps
- 1Checked kubectl describe pod and found that the pods were not assigned IPs.
- 2Inspected Calico configuration and discovered that the IP pool settings were not properly carried over during the upgrade.
Root Cause
The upgrade process failed to migrate the IP pool configuration, leading to network connectivity issues for the pods.
Fix/Workaround
• Manually updated the Calico configuration to restore the correct IP pool settings.
• Restarted the Calico pods and verified pod connectivity.Lessons Learned
Ensure network plugin upgrades are carefully tested and configurations are validated after upgrades.
How to Avoid
- 1Perform network plugin upgrades in a staging environment before applying to production.
- 2Use configuration management tools to keep track of network plugin settings.