[2.2] Deleting machines from Nodes listing page tries decomposing multiple times.
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
MAAS |
Fix Released
|
Critical
|
Newell Jensen | ||
MAAS RSD |
Fix Released
|
Critical
|
Newell Jensen |
Bug Description
Deleting machines from an RSD Pod in the UI Nodes listing page causes errors. From what I could gather this was caused because MAAS is trying to delete the machines twice which causes the decompose signal to try and decompose the machine twice. Since the machine has already been decomposed we are getting a 404 error back from the RSD Redfish API. With some print statements we can see in the logs below that the first node to try and be deleted twice is node_id 302:
==> /var/log/
Feb 23 22:11:04 maas-dev maas.node: [info] driven-toad: Deleting node
Feb 23 22:11:04 maas-dev maas.node: [info] fancy-cub: Deleting node
Feb 23 22:11:04 maas-dev maas.node: [info] deep-piglet: Deleting node
Feb 23 22:11:04 maas-dev maas.node: [info] driven-marten: Deleting node
==> /var/log/
2017-02-23 22:11:04 stdout: [info] instance.
2017-02-23 22:11:04 stdout: [info] instance.
==> /var/log/
2017-02-23 22:11:04 stdout: [info] decompose node_id: b'304'
==> /var/log/
2017-02-23 22:11:04 stdout: [info] instance.
2017-02-23 22:11:04 stdout: [info] instance.
2017-02-23 22:11:04 stdout: [info] instance.
2017-02-23 22:11:04 stdout: [info] instance.
==> /var/log/
2017-02-23 22:11:04 stdout: [info] decompose node_id: b'302'
2017-02-23 22:11:04 stdout: [info] decompose node_id: b'303'
==> /var/log/
Feb 23 22:11:04 maas-dev maas.node: [info] fluent-molly: Deleting node
Feb 23 22:11:04 maas-dev maas.node: [info] full-kiwi: Deleting node
Feb 23 22:11:04 maas-dev maas.node: [info] many-dory: Deleting node
==> /var/log/
2017-02-23 22:11:05 stdout: [info] instance.
2017-02-23 22:11:05 stdout: [info] instance.
==> /var/log/
2017-02-23 22:11:05 stdout: [info] decompose node_id: b'301'
==> /var/log/
Feb 23 22:11:13 maas-dev maas.node: [info] driven-marten: Deleting node
==> /var/log/
2017-02-23 22:11:13 stdout: [info] instance.
2017-02-23 22:11:13 stdout: [info] instance.
==> /var/log/
2017-02-23 22:11:13 stdout: [info] decompose node_id: b'302'
==> /var/log/
Feb 23 22:11:13 maas-dev maas.node: [info] deep-piglet: Deleting node
==> /var/log/
2017-02-23 22:11:13 provisioningser
Traceback (most recent call last):
File "/usr/lib/
self.
File "/usr/lib/
self.
File "/usr/lib/
current.result = callback(
File "/usr/lib/
_inlineCall
--- <exception caught here> ---
File "/usr/lib/
result = result.
File "/usr/lib/
return g.throw(self.type, self.value, self.tb)
File "/usr/lib/
Related branches
- Blake Rouse (community): Approve
-
Diff: 141 lines (+76/-19)2 files modifiedsrc/provisioningserver/drivers/pod/rsd.py (+12/-2)
src/provisioningserver/drivers/pod/tests/test_rsd.py (+64/-17)
Changed in maas: | |
status: | New → Triaged |
importance: | Undecided → Critical |
Changed in maas: | |
milestone: | none → 2.2.0 |
Changed in maasrsd: | |
milestone: | none → alpha |
milestone: | alpha → beta |
summary: |
- Deleting machines from Nodes listing page tries decomposing multiple - times. + [2.2] Deleting machines from Nodes listing page tries decomposing + multiple times. |
Changed in maas: | |
assignee: | nobody → Newell Jensen (newell-jensen) |
Changed in maasrsd: | |
assignee: | nobody → Newell Jensen (newell-jensen) |
Changed in maas: | |
status: | Triaged → In Progress |
Changed in maasrsd: | |
status: | Triaged → In Progress |
Changed in maas: | |
status: | In Progress → Fix Committed |
Changed in maasrsd: | |
status: | In Progress → Fix Committed |
Changed in maas: | |
status: | Fix Committed → Fix Released |
Changed in maasrsd: | |
status: | Fix Committed → Fix Released |
Additionally, this seems to only happen if we attempt to delete more than one machine at the same time. Deleting one machine at a time does not cause this.