Back to all scenarios
Scenario #126
Networking
K8s v1.19, DigitalOcean Kubernetes

Pod Network Disruptions Due to CNI Plugin Update

Pods experienced network disruptions after updating the CNI plugin to a newer version.

Find this helpful?
What Happened

After upgrading the CNI plugin, network connectivity between pods was disrupted, causing intermittent traffic drops.

Diagnosis Steps
  • 1Checked CNI plugin logs and found that the new version introduced a bug affecting pod networking.
  • 2Downgraded the CNI plugin version to verify that the issue was related to the upgrade.
Root Cause

A bug in the newly installed version of the CNI plugin.

Fix/Workaround
• Rolled back to the previous version of the CNI plugin.
• Reported the bug to the plugin maintainers and kept the older version in place until a fix was released.
Lessons Learned

Always test new CNI plugin versions in a staging environment before upgrading production clusters.

How to Avoid
  • 1Implement a thorough testing procedure for CNI plugin upgrades.
  • 2Use version locking for CNI plugins to avoid unintentional upgrades.