Activity log for bug #2034014

Date Who What changed Old value New value Message
2023-09-04 07:08:58 Marian Gasparovic bug added bug
2023-09-04 08:18:22 Marian Gasparovic description Since Aug 31 we started to receive this error when we deploy machines with Terraform MAAS provider Error: ServerError: 409 Conflict (<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "[http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd](http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd)"> <html xmlns="[http://www.w3.org/1999/xhtml](http://www.w3.org/1999/xhtml)" xml:lang="en" lang="en"> <head> <title>Error: Conflict Error</title> </head> <body> <h2 class="p-heading--four"> Conflict error. Try your request again, as it will most likely succeed. </h2> </body> </html> ) It happens only in our long running MAAS which serves six "silos". We have another two silos where we deploy new MAAS every time, we did not encounter this error there. Both long running and freshly deployed MAAS's are 3.2.9 This seems like an issue which happens after MAAS is up for some time. We did not encounter it before Aug 31 and many times since. I will update with exact number after I triage all. Typical example is here https://oil-jenkins.canonical.com/artifacts/d356f7bc-91ad-4a86-a5e8-30d16af4f379/index.html I will upload MAAS logs later. I was observing one of the runs when it was happening. It was supposed to deploy six machines using tag as constraint. I could see 6 machines with tags available but during TF run it started to deploy only five4 of them, it did not touch the sixth. Since Aug 31 we started to receive this error when we deploy machines with Terraform MAAS provider Error: ServerError: 409 Conflict (<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "[http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd](http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd)"> <html xmlns="[http://www.w3.org/1999/xhtml](http://www.w3.org/1999/xhtml)" xml:lang="en" lang="en">   <head>     <title>Error: Conflict Error</title>   </head>   <body>     <h2 class="p-heading--four">       Conflict error. Try your request again, as it will most likely succeed.     </h2>   </body> </html> ) It happens only in our long running MAAS which serves six "silos". We have another two silos where we deploy new MAAS every time, we did not encounter this error there. Both long running and freshly deployed MAAS's are 3.2.9 This seems like an issue which happens after MAAS is up for some time. We did not encounter it before Aug 31 and many times since. I will update with exact number after I triage all. Typical example is here https://oil-jenkins.canonical.com/artifacts/d356f7bc-91ad-4a86-a5e8-30d16af4f379/index.html I will upload MAAS logs later. I was observing one of the runs when it was happening. It was supposed to deploy six machines using tag as constraint. I could see 6 machines with tags available but during TF run it started to deploy only five4 of them, it did not touch the sixth. We hit this bug 34 times in 81 test runs in four days.
2023-09-04 12:03:00 Jacopo Rota maas: assignee Jacopo Rota (r00ta)
2023-09-04 12:03:09 Jacopo Rota nominated for series maas/3.2
2023-09-04 12:03:09 Jacopo Rota bug task added maas/3.2
2023-09-04 18:02:16 Jacopo Rota nominated for series maas/3.3
2023-09-04 18:02:16 Jacopo Rota bug task added maas/3.3
2023-09-04 18:02:16 Jacopo Rota nominated for series maas/3.4
2023-09-04 18:02:16 Jacopo Rota bug task added maas/3.4
2023-09-04 18:02:16 Jacopo Rota nominated for series maas/3.5
2023-09-04 18:02:16 Jacopo Rota bug task added maas/3.5
2023-09-04 18:02:20 Jacopo Rota maas/3.4: assignee Jacopo Rota (r00ta)
2023-09-04 18:02:22 Jacopo Rota maas/3.3: assignee Jacopo Rota (r00ta)
2023-09-04 18:02:24 Jacopo Rota maas/3.2: assignee Jacopo Rota (r00ta)
2023-09-04 18:02:27 Jacopo Rota maas/3.5: importance Undecided High
2023-09-04 18:02:29 Jacopo Rota maas/3.4: importance Undecided High
2023-09-04 18:02:30 Jacopo Rota maas/3.3: importance Undecided High
2023-09-04 18:02:32 Jacopo Rota maas/3.2: importance Undecided High
2023-09-04 18:02:35 Jacopo Rota maas/3.5: status New Triaged
2023-09-04 18:02:36 Jacopo Rota maas/3.4: status New Triaged
2023-09-04 18:02:38 Jacopo Rota maas/3.3: status New Triaged
2023-09-04 18:02:39 Jacopo Rota maas/3.2: status New Triaged
2023-09-07 09:45:12 Jacopo Rota merge proposal linked https://code.launchpad.net/~r00ta/maas/+git/maas/+merge/450867
2023-09-07 09:45:21 Jacopo Rota maas/3.5: milestone 3.5.0
2023-09-07 09:45:34 Jacopo Rota maas/3.5: status Triaged In Progress
2023-09-11 06:19:41 MAAS Lander maas/3.5: status In Progress Fix Committed
2023-09-12 09:45:48 Adam Collard merge proposal linked https://code.launchpad.net/~r00ta/maas/+git/maas/+merge/451151
2023-09-12 09:56:37 Jacopo Rota maas/3.4: milestone 3.4.x
2023-09-12 09:56:41 Jacopo Rota maas/3.3: milestone 3.3.x
2023-09-12 09:56:45 Jacopo Rota maas/3.2: milestone 3.2.x
2023-09-12 09:56:55 Jacopo Rota maas/3.4: status Triaged Fix Committed
2023-09-12 09:56:56 Jacopo Rota maas/3.3: status Triaged Fix Committed
2023-09-12 09:56:58 Jacopo Rota maas/3.2: status Triaged Fix Committed
2023-10-06 14:18:59 Adam Collard merge proposal linked https://code.launchpad.net/~r00ta/maas/+git/maas/+merge/451150