Standalone jobs in component lines of wallaby on centos 9 fails standalone deploy with
FATAL | Run init bundle puppet on the host for mysql | standalone | error={"changed": false, "cmd": "puppet apply --detailed-exitcodes --summarize --color=false --modulepath '/etc/puppet/modules:/opt/stack/puppet-modules:/usr/share/openstack-puppet/modules' --tags 'pacemaker::resource::bundle,pacemaker::property,pacemaker::resource::ocf,pacemaker::constraint::order,pacemaker::constraint::colocation' -e '[\"Mysql_datadir\", \"Mysql_user\", \"Mysql_database\", \"Mysql_grant\", \"Mysql_plugin\"].each |String $val| { noop_resource($val) }; include ::tripleo::profile::base::pacemaker; include ::tripleo::profile::pacemaker::database::mysql_bundle'\n", "delta": "0:01:05.671113", "end": "2023-06-06 09:46:35.728695", "failed_when_result": true, "msg": "non-zero return code", "rc": 6, "start": "2023-06-06 09:45:30.057582", "stderr": "Warning: /etc/puppet/hiera.yaml: Use of 'hiera.yaml' version 3 is deprecated. It should be converted to version 5\n (file: /etc/puppet/hiera.yaml)\nWarning: Undefined variable '::deploy_config_name'; \n (file & line not available)\nWarning: The function 'hiera' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.10/deprecated_language.html\n (file & line not available)\nDeprecation Warning: This command is deprecated and will be removed. Please use 'pcs property config' instead.\nDeprecation Warning: This command is deprecated and will be removed. Please use 'pcs constraint config' instead.\nDeprecation Warning: This command is deprecated and will be removed. Please use 'pcs constraint config' instead.\nError: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20230606-141681-1fra7qk constraint location galera-bundle rule resource-discovery=exclusive score=0 galera-role eq true failed: Error: duplicate constraint already exists, use --force to override. Too many tries\nError: /Stage[main]/Tripleo::Profile::Pacemaker::Database::Mysql_bundle/Pacemaker::Resource::Ocf[galera]/Pcmk_resource[galera]/ensure: change from 'absent' to 'present' failed: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20230606-141681-1fra7qk constraint location galera-bundle rule resource-discovery=exclusive score=0 galera-role eq true failed: Error: duplicate constraint already exists, use --force to override. Too many tries", "stderr_lines": ["Warning: /etc/puppet/hiera.yaml: Use of 'hiera.yaml' version 3 is deprecated. It should be converted to version 5", " (file: /etc/puppet/hiera.yaml)", "Warning: Undefined variable '::deploy_config_name'; ", " (file & line not available)", "Warning: The function 'hiera' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.10/deprecated_language.html", " (file & line not available)", "Deprecation Warning: This command is deprecated and will be removed. Please use 'pcs property config' instead.", "Deprecation Warning: This command is deprecated and will be removed. Please use 'pcs constraint config' instead.", "Deprecation Warning: This command is deprecated and will be removed. Please use 'pcs constraint config' instead.", "Error: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20230606-141681-1fra7qk constraint location galera-bundle rule resource-discovery=exclusive score=0 galera-role eq true failed: Error: duplicate constraint already exists, use --force to override. Too many tries", "Error: /Stage[main]/Tripleo::Profile::Pacemaker::Database::Mysql_bundle/Pacemaker::Resource::Ocf[galera]/Pcmk_resource[galera]/ensure: change from 'absent' to 'present' failed: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20230606-141681-1fra7qk constraint location galera-bundle rule resource-discovery=exclusive score=0 galera-role eq true failed: Error: duplicate constraint already exists, use --force to override. Too many tries"], "stdout": "Notice: Compiled catalog for standalone.localdomain in environment production in 1.68 seconds\nNotice: /Stage[main]/Pacemaker::Stonith/Pacemaker::Property[Disable STONITH]/Pcmk_property[property--stonith-enabled]/ensure: created\nNotice: /Stage[main]/Tripleo::Profile::Pacemaker::Database::Mysql_bundle/Pacemaker::Property[galera-role-standalone]/Pcmk_property[property-standalone-galera-role]/ensure: created\nNotice: /Stage[main]/Tripleo::Profile::Pacemaker::Database::Mysql_bundle/Pacemaker::Resource::Bundle[galera-bundle]/Pcmk_bundle[galera-bundle]/ensure: created\nNotice: Applied catalog in 59.55 seconds\nApplication:\n Initial environment: production\n Converged environment: production\n Run mode: user\nChanges:\n Total: 3\nEvents:\n Failure: 1\n Success: 3\n Total: 4\nResources:\n Failed: 1\n Skipped: 141\n Changed: 3\n Out of sync: 4\n Total: 145\nTime:\n Config retrieval: 1.90\n Last run: 1686044795\n Pcmk resource: 43.14\n Transaction evaluation: 59.54\n Catalog application: 59.55\n Pcmk property: 6.70\n Pcmk bundle: 9.45\n Total: 59.55\nVersion:\n Config: 1686044734\n Puppet: 7.10.0", "stdout_lines": ["Notice: Compiled catalog for standalone.localdomain in environment production in 1.68 seconds", "Notice: /Stage[main]/Pacemaker::Stonith/Pacemaker::Property[Disable STONITH]/Pcmk_property[property--stonith-enabled]/ensure: created", "Notice: /Stage[main]/Tripleo::Profile::Pacemaker::Database::Mysql_bundle/Pacemaker::Property[galera-role-standalone]/Pcmk_property[property-standalone-galera-role]/ensure: created", "Notice: /Stage[main]/Tripleo::Profile::Pacemaker::Database::Mysql_bundle/Pacemaker::Resource::Bundle[galera-bundle]/Pcmk_bundle[galera-bundle]/ensure: created", "Notice: Applied catalog in 59.55 seconds", "Application:", " Initial environment: production", " Converged environment: production", " Run mode: user", "Changes:", " Total: 3", "Events:", " Failure: 1", " Success: 3", " Total: 4", "Resources:", " Failed: 1", " Skipped: 141", " Changed: 3", " Out of sync: 4", " Total: 145", "Time:", " Config retrieval: 1.90", " Last run: 1686044795", " Pcmk resource: 43.14", " Transaction evaluation: 59.54", " Catalog application: 59.55", " Pcmk property: 6.70", " Pcmk bundle: 9.45", " Total: 59.55", "Version:", " Config: 1686044734", " Puppet: 7.10.0"]}
We see this since 2023-06-06
Logs:
https://logserver.rdoproject.org/openstack-component-glance/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-glance-wallaby/d42fd9a/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz
https://logserver.rdoproject.org/openstack-component-compute/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-compute-wallaby-validation/6f98989/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz
Additional logs:
https:/