puppet-openstack-integration

enabling neutron-ovn-metadata-agent consistently fails in CentOS 9

Bug #1988552 reported by Takashi Kajinami
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
puppet-openstack-integration
Invalid
Critical
Takashi Kajinami

Bug Description

Currently scenario 003 and 005 are consistently failing, because puppet fails to enable the neutron-ovn-metadata-agent service.

After enabling the debug log shows, I confirmed that `systemctl enable -- neutron-ovn-metadata-agent` is somehow failing.

2022-09-02 10:21:27 +0000 Class[Neutron::Server] (debug): The container Stage[main] will propagate my refresh event
2022-09-02 10:21:27 +0000 Puppet (debug): Executing: '/bin/systemctl is-active -- neutron-ovn-metadata-agent'
2022-09-02 10:21:27 +0000 Puppet (debug): Executing: '/bin/systemctl is-enabled -- neutron-ovn-metadata-agent'
2022-09-02 10:21:27 +0000 Puppet (debug): Executing: '/bin/systemctl show --property=NeedDaemonReload -- neutron-ovn-metadata-agent'
2022-09-02 10:21:27 +0000 Puppet (debug): Executing: '/bin/systemctl unmask -- neutron-ovn-metadata-agent'
2022-09-02 10:21:27 +0000 Puppet (debug): Executing: '/bin/systemctl start -- neutron-ovn-metadata-agent'
2022-09-02 10:21:27 +0000 Puppet (debug): Executing: '/bin/systemctl is-enabled -- neutron-ovn-metadata-agent'
2022-09-02 10:21:27 +0000 Puppet (debug): Executing: '/bin/systemctl unmask -- neutron-ovn-metadata-agent'
2022-09-02 10:21:28 +0000 Puppet (debug): Executing: '/bin/systemctl enable -- neutron-ovn-metadata-agent'
2022-09-02 10:21:28 +0000 Puppet (err): Could not enable neutron-ovn-metadata-agent:
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/execution.rb:286:in `execute'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/provider/command.rb:23:in `execute'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/provider.rb:209:in `block in has_command'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/provider.rb:431:in `block in create_class_and_instance_method'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/provider/service/systemd.rb:69:in `systemctl_change_enable'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/provider/service/systemd.rb:163:in `enable'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/type/service.rb:69:in `block (3 levels) in <module:Puppet>'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/property.rb:490:in `set'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/property.rb:570:in `sync'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/type/service.rb:131:in `sync'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:241:in `sync'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:136:in `sync_if_needed'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:82:in `perform_changes'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:21:in `evaluate'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction.rb:267:in `apply'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction.rb:288:in `eval_resource'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction.rb:191:in `call'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction.rb:191:in `block (2 levels) in evaluate'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:556:in `block in thinmark'
/opt/puppetlabs/puppet/lib/ruby/2.7.0/benchmark.rb:308:in `realtime'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:555:in `thinmark'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction.rb:191:in `block in evaluate'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/graph/relationship_graph.rb:122:in `traverse'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction.rb:178:in `evaluate'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:238:in `block (2 levels) in apply'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:556:in `block in thinmark'
/opt/puppetlabs/puppet/lib/ruby/2.7.0/benchmark.rb:308:in `realtime'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:555:in `thinmark'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:237:in `block in apply'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/log.rb:165:in `with_destination'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/transaction/report.rb:150:in `as_logging_destination'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:236:in `apply'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/configurer.rb:286:in `block (2 levels) in apply_catalog'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:556:in `block in thinmark'
/opt/puppetlabs/puppet/lib/ruby/2.7.0/benchmark.rb:308:in `realtime'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:555:in `thinmark'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/configurer.rb:285:in `block in apply_catalog'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:234:in `block in benchmark'
/opt/puppetlabs/puppet/lib/ruby/2.7.0/benchmark.rb:308:in `realtime'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:233:in `benchmark'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/configurer.rb:284:in `apply_catalog'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/configurer.rb:500:in `run_internal'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/configurer.rb:339:in `run'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/apply.rb:361:in `apply_catalog'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/apply.rb:273:in `block in main'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:62:in `override'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:289:in `override'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/apply.rb:212:in `main'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application/apply.rb:182:in `run_command'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application.rb:421:in `block in run'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util.rb:745:in `exit_on_fail'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/application.rb:421:in `run'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/command_line.rb:143:in `run'
/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/command_line.rb:77:in `execute'
/opt/puppetlabs/puppet/bin/puppet:5:in `<main>'
2022-09-02 10:21:28 +0000 /Stage[main]/Neutron::Agents::Ovn_metadata/Service[ovn-metadata]/ensure (err): change from 'stopped' to 'running' failed: Could not enable neutron-ovn-metadata-agent:
2022-09-02 10:21:28 +0000 Puppet (debug): Executing: '/bin/systemctl is-active -- neutron-ovn-metadata-agent'
2022-09-02 10:21:28 +0000 Puppet (debug): Executing: '/bin/systemctl show --property=NeedDaemonReload -- neutron-ovn-metadata-agent'
2022-09-02 10:21:28 +0000 Puppet (debug): Executing: '/bin/systemctl restart -- neutron-ovn-metadata-agent'
2022-09-02 10:21:28 +0000 /Service[ovn-metadata] (notice): Triggered 'refresh' from 2 events
2022-09-02 10:21:28 +0000 /Service[ovn-metadata] (info): Scheduling refresh of Anchor[neutron::service::end]

Takashi Kajinami (kajinamit)
Changed in puppet-openstack-integration:
importance: Undecided → Critical
Revision history for this message
Takashi Kajinami (kajinamit) wrote :

I've reported the issue to RDO for their awareness.
 https://bugzilla.redhat.com/show_bug.cgi?id=2123742

Digging into the problem further, I confirmed the issue is caused by the recent update of systemd.
I've reported the issue to CentOS Stream as well.
 https://bugzilla.redhat.com/show_bug.cgi?id=2123927

Changed in puppet-openstack-integration:
assignee: nobody → Takashi Kajinami (kajinamit)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on puppet-openstack-integration (master)

Change abandoned by "Takashi Kajinami <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/855617
Reason: The issue was fixed by https://review.rdoproject.org/r/c/openstack/neutron-distgit/+/44751

Revision history for this message
Takashi Kajinami (kajinamit) wrote :

I'll close this as Invalid because the issue was fixed by https://review.rdoproject.org/r/c/openstack/neutron-distgit/+/44751

Changed in puppet-openstack-integration:
status: New → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.