dns-provider=kube-dns fails in K8s 1.20
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
CDK Addons |
Triaged
|
Medium
|
Unassigned | ||
Charmed Kubernetes Testing |
Fix Released
|
Medium
|
Mateo Florido | ||
Kubernetes Control Plane Charm |
Fix Released
|
Medium
|
Mateo Florido |
Bug Description
Hi team,
test_dns_provider never stops on K8s 1.20 as the charm fails to enable kube-dns and the test waits for coredns pod to be removed:
=======
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1 -- /home/ubuntu/
cachedir: .tox/py3/
metadata: {'Python': '3.8.5', 'Platform': 'Linux-
rootdir: /home/ubuntu/
plugins: flaky-3.7.0, metadata-1.10.0, asyncio-0.14.0, html-2.1.1
collecting ... collected 1 item
jobs/integratio
-------
unknown facade CAASModelOperator
unexpected facade CAASModelOperator found, unable to decipher version to use
unknown delta type: id
Waiting for coredns pods to be removed
2021-03-25-18:42:17 root ERROR [localhost] STDERR follows:
None
Traceback (most recent call last):
File "/usr/local/
load_
File "/home/
sys.
File "/home/
opts.func(opts)
File "/home/
layer.
File "/home/
validator.run()
File "/home/
self.
File "/home/
self.
File "/home/
local(cmd, output_mode="live", env=my_env)
File "/home/
return run_cmd(cmd, target_machine, **kwargs)
File "/home/
raise subprocess.
Looking in the kubernetes-master's Juju logs we see this:
2021-03-25 19:29:39 INFO juju-log Invoking reactive handler: reactive/
2021-03-25 19:30:03 WARNING update-status Resource: "/v1, Resource=services", GroupVersionKind: "/v1, Kind=Service"
2021-03-25 19:30:45 WARNING update-status Name: "kube-dns", Namespace: "kube-system"
2021-03-25 19:30:49 INFO juju-log Checking if snap.kube-
2021-03-25 19:34:52 WARNING update-status
2021-03-25 19:35:35 WARNING update-status cmd ['/snap/
2021-03-25 19:35:56 WARNING update-status Name: "kube-dns", Namespace: "kube-system"
2021-03-25 19:35:56 WARNING update-status for: "/root/
2021-03-25 19:35:56 WARNING update-status Error from server (BadRequest): error when creating "/root/
2021-03-25 19:35:56 INFO juju-log Addons are not ready yet.
Please fix.
summary: |
- test_dns_provider fails to switch to kube-dns in K8s 1.20 + dns-provider=kube-dns fails in K8s 1.20 |
Changed in charm-kubernetes-master: | |
status: | Triaged → In Progress |
assignee: | nobody → Mateo Florido (mateoflorido) |
milestone: | none → 1.26 |
Changed in charmed-kubernetes-testing: | |
milestone: | none → 1.26 |
assignee: | nobody → Mateo Florido (mateoflorido) |
Changed in charmed-kubernetes-testing: | |
status: | Fix Committed → Fix Released |
Changed in charm-kubernetes-master: | |
status: | Fix Committed → Fix Released |
I could reproduce that DNS issue just by 'juju config kubernetes-master dns-provider= kube-dns' and the coredns pods will keep running after that. also in juju status:
kubernetes- master/ 0* waiting idle 9 10.254.9.237 6443/tcp Waiting to retry addon deployment
and in it's logs I see the errors mentioned in the bug description.