Problems switching from kube-dns to CoreDNS

Bug #1822001 reported by Tim Van Steenburgh
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Kubernetes Control Plane Charm
Fix Released
High
George Kraft

Bug Description

18:34 <knobby> `juju upgrade-charm etcd` `juju upgrade-charm ...` `juju config kubernetes-master dns-provider=core-dns`
18:35 <knobby> I then saw that I was on 1.14 for my workers and 1.13 for my master, I don't recall ever setting the channel on the worker, but it's possible it's set to ""
18:35 <knobby> I noticed that kube-dns was gone and no new dns was coming up
18:35 <knobby> I then thought it might be the cdk-addons snap, so I went and sudo snap refresh cdk-addons on the masters
18:36 <knobby> waited for hooks and no interesting things happened
18:36 <knobby> then I `juju config kubernetes-master channel="1.14/stable"` and then ran the upgrade action on each node
18:36 <knobby> at which point I got core-dns, but all my pods were exploding because they couldn't resolve names
18:37 <knobby> cat /etc/resolv.conf pointed at an old service ip
18:37 <knobby> kubectl delete po/<pod> results in a working pod

Changed in cdk-addons:
importance: Undecided → High
status: New → Triaged
Changed in cdk-addons:
assignee: nobody → George Kraft (cynerva)
milestone: none → 1.14
Changed in charm-kubernetes-master:
status: New → Triaged
importance: Undecided → High
assignee: nobody → George Kraft (cynerva)
milestone: none → 1.14
Revision history for this message
Tim Van Steenburgh (tvansteenburgh) wrote :

I guess we need to either:

1. Backport CoreDNS to older cdk-addons, or
2. Make it a no-op if you pick CoreDNS but you're on 1.13 or older snaps

I'm okay with either. The trouble with #2 is making it obvious to the user why nothing is happening.

George Kraft (cynerva)
Changed in charm-kubernetes-master:
status: Triaged → In Progress
Revision history for this message
George Kraft (cynerva) wrote :

PR: https://github.com/juju-solutions/kubernetes/pull/228

This makes the charm block with an appropriate message if dns-provider has an invalid value.

George Kraft (cynerva)
Changed in charm-kubernetes-master:
status: In Progress → Fix Committed
no longer affects: cdk-addons
Changed in charm-kubernetes-master:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.