migrated sidecar unit agents keep restarting due to a mismatch charmModifiedVersion

Bug #2009566 reported by Yang Kelvin Liu
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Canonical Juju
Fix Released
Critical
Yang Kelvin Liu
2.9
Fix Released
Critical
Unassigned
3.1
Fix Released
Critical
Unassigned

Bug Description

The migrated sidecar agents in a k8s model keep restarting due to a mismatch charmModifiedVersion.

Reproduce steps:
juju deploy prometheus-k8s --trust
juju deploy cs:~juju/mariadb-k8s-3

juju migrate k1:t1 k2

unit-prometheus-k8s-0: 17:46:42 INFO juju.worker.uniter unit "prometheus-k8s/0" started
unit-prometheus-k8s-0: 17:46:42 WARNING juju.worker.uniter charmModifiedVersion: 1, u.enforcedCharmModifiedVersion 0
unit-prometheus-k8s-0: 17:46:42 INFO juju.worker.uniter remote charm modified version (1) does not match agent's (0)
unit-prometheus-k8s-0: 17:46:42 INFO juju.worker.uniter unit "prometheus-k8s/0" shutting down: agent should be terminated
unit-prometheus-k8s-2: 17:46:54 INFO juju.cmd running containerAgent [2.9.43 1b2c08fb16deae89ee6ef6f26bcbf08b8d4cf04e gc go1.19.6]
unit-prometheus-k8s-2: 17:46:54 INFO juju.cmd.containeragent.unit start "unit"
unit-prometheus-k8s-2: 17:46:54 INFO juju.worker.upgradesteps upgrade steps for 2.9.43 have already been run.
unit-prometheus-k8s-2: 17:46:54 INFO juju.worker.probehttpserver starting http server on [::]:65301
unit-prometheus-k8s-2: 17:46:54 INFO juju.api cannot resolve "controller-service.controller-k2.svc.cluster.local": lookup controller-service.controller-k2.svc.cluster.local: operation was canceled
unit-prometheus-k8s-2: 17:46:54 INFO juju.api connection established to "wss://10.152.183.142:17070/model/31be4e66-318d-4c13-8881-9bff9d70b896/api"
unit-prometheus-k8s-2: 17:46:54 INFO juju.worker.apicaller [31be4e] "unit-prometheus-k8s-2" successfully connected to "10.152.183.142:17070"
unit-prometheus-k8s-2: 17:46:54 INFO juju.api connection established to "wss://controller-service.controller-k2.svc.cluster.local:17070/model/31be4e66-318d-4c13-8881-9bff9d70b896/api"
unit-prometheus-k8s-2: 17:46:54 INFO juju.worker.apicaller [31be4e] "unit-prometheus-k8s-2" successfully connected to "controller-service.controller-k2.svc.cluster.local:17070"
unit-prometheus-k8s-2: 17:46:54 INFO juju.worker.migrationminion migration phase is now: NONE
unit-prometheus-k8s-2: 17:46:54 INFO juju.worker.logger logger worker started
unit-prometheus-k8s-2: 17:46:54 INFO juju.worker.leadership prometheus-k8s leadership for prometheus-k8s/2 denied
unit-prometheus-k8s-2: 17:46:54 WARNING juju.worker.proxyupdater unable to set snap core settings [proxy.http= proxy.https= proxy.store=]: exec: "snap": executable file not found in $PATH, output: ""
unit-prometheus-k8s-2: 17:46:55 INFO juju.worker.caasupgrader abort check blocked until version event received
unit-prometheus-k8s-2: 17:46:55 INFO juju.worker.caasupgrader unblocking abort check
unit-prometheus-k8s-2: 17:46:55 INFO juju.agent.tools ensure jujuc symlinks in /var/lib/juju/tools/unit-prometheus-k8s-2
unit-prometheus-k8s-2: 17:46:55 INFO juju.worker.uniter unit "prometheus-k8s/2" started
unit-prometheus-k8s-2: 17:46:55 WARNING juju.worker.uniter charmModifiedVersion: 1, u.enforcedCharmModifiedVersion 0
unit-prometheus-k8s-2: 17:46:55 INFO juju.worker.uniter remote charm modified version (1) does not match agent's (0)
unit-prometheus-k8s-2: 17:46:55 INFO juju.worker.uniter unit "prometheus-k8s/2" shutting down: agent should be terminated
unit-prometheus-k8s-0: 17:47:17 INFO juju.cmd running containerAgent [2.9.43 1b2c08fb16deae89ee6ef6f26bcbf08b8d4cf04e gc go1.19.6]
unit-prometheus-k8s-0: 17:47:17 INFO juju.cmd.containeragent.unit start "unit"
unit-prometheus-k8s-0: 17:47:17 INFO juju.worker.upgradesteps upgrade steps for 2.9.43 have already been run.

Tags: k8s
Changed in juju:
milestone: none → 2.9.43
assignee: nobody → Yang Kelvin Liu (kelvin.liu)
importance: Undecided → Critical
status: New → Triaged
status: Triaged → In Progress
description: updated
tags: added: k8s
summary: - migrated sidecar unit agents keep restarting
+ migrated sidecar unit agents keep restarting due to a mismatch
+ charmModifiedVersion
Revision history for this message
Yang Kelvin Liu (kelvin.liu) wrote :
Changed in juju:
status: In Progress → Fix Committed
Changed in juju:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.