the target controller keeps complaining if a sidecar app was migrated due to statefulset apply conflicts in provisioner worker

Bug #2008744 reported by Yang Kelvin Liu
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Canonical Juju
Fix Released
Critical
Yang Kelvin Liu
2.9
Fix Released
Critical
Unassigned
3.1
Fix Released
Critical
Unassigned

Bug Description

Reproduce steps:
juju add-model t1

juju deploy prometheus-k8s --trust

juju migrate k1:t1 k2

The target controller log shows:

controller-0: 11:29:23 INFO juju.apiserver.common setting password for "application-prometheus-k8s"
controller-0: 11:29:25 WARNING juju.kubernetes.provider.resources rollback failed Secret prometheus-k8s-application-config: resource version conflict
controller-0: 11:29:25 ERROR juju.kubernetes.provider.application Ensure StatefulSet.apps "prometheus-k8s" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden
controller-0: 11:29:28 INFO juju.apiserver.common setting password for "application-prometheus-k8s"
controller-0: 11:29:30 WARNING juju.kubernetes.provider.resources rollback failed Secret prometheus-k8s-application-config: resource version conflict
controller-0: 11:29:30 ERROR juju.kubernetes.provider.application Ensure StatefulSet.apps "prometheus-k8s" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden
controller-0: 11:29:33 INFO juju.apiserver.common setting password for "application-prometheus-k8s"
controller-0: 11:29:35 WARNING juju.kubernetes.provider.resources rollback failed Secret prometheus-k8s-application-config: resource version conflict
controller-0: 11:29:35 ERROR juju.kubernetes.provider.application Ensure StatefulSet.apps "prometheus-k8s" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden
controller-0: 11:29:38 INFO juju.apiserver.common setting password for "application-prometheus-k8s"
controller-0: 11:29:40 WARNING juju.kubernetes.provider.resources rollback failed Secret prometheus-k8s-application-config: resource version conflict
controller-0: 11:29:40 ERROR juju.kubernetes.provider.application Ensure StatefulSet.apps "prometheus-k8s" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden
controller-0: 11:29:43 INFO juju.apiserver.common setting password for "application-prometheus-k8s"
controller-0: 11:29:45 WARNING juju.kubernetes.provider.resources rollback failed Secret prometheus-k8s-application-config: resource version conflict
controller-0: 11:29:45 ERROR juju.kubernetes.provider.application Ensure StatefulSet.apps "prometheus-k8s" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden
controller-0: 11:29:48 INFO juju.apiserver.common setting password for "application-prometheus-k8s"

controller-0: 11:44:43 INFO juju.worker.caasapplicationprovisioner.runner restarting "prometheus-k8s" in 3s
controller-0: 11:44:46 INFO juju.worker.caasapplicationprovisioner.runner start "prometheus-k8s"
controller-0: 11:44:48 INFO juju.worker.caasapplicationprovisioner.runner stopped "prometheus-k8s", err: ensuring application "prometheus-k8s": StatefulSet.apps "prometheus-k8s" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden
controller-0: 11:44:48 ERROR juju.worker.caasapplicationprovisioner.runner exited "prometheus-k8s": ensuring application "prometheus-k8s": StatefulSet.apps "prometheus-k8s" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden
controller-0: 11:44:48 INFO juju.worker.caasapplicationprovisioner.runner restarting "prometheus-k8s" in 3s
controller-0: 11:44:51 INFO juju.worker.caasapplicationprovisioner.runner start "prometheus-k8s"
controller-0: 11:44:53 INFO juju.worker.caasapplicationprovisioner.runner stopped "prometheus-k8s", err: ensuring application "prometheus-k8s": StatefulSet.apps "prometheus-k8s" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden

Changed in juju:
importance: Undecided → High
status: New → Triaged
milestone: none → 3.1.2
milestone: 3.1.2 → 3.1.1
Changed in juju:
importance: High → Critical
Changed in juju:
status: Triaged → In Progress
Changed in juju:
milestone: 3.1.1 → 2.9.43
summary: the target controller keeps complaining if a sidecar app was migrated
+ due to statefulset apply conflicts in provisioner worker
Changed in juju:
assignee: nobody → Yang Kelvin Liu (kelvin.liu)
Revision history for this message
Yang Kelvin Liu (kelvin.liu) wrote :
Changed in juju:
status: In Progress → Fix Committed
Changed in juju:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.