juju2beta12: unable to destroy controller properly on localhost

Bug #1604931 reported by Adam Stokes
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Canonical Juju
Fix Released
Critical
Ian Booth

Bug Description

Running:

```
ubuntu@tupac:~/conjure$ juju destroy-controller --destroy-all-models marquitta
```

Results in:

```
WARNING! This command will destroy the "marquitta" controller.
This includes all machines, applications, data and other resources.

Continue [y/N]? y
Destroying controller
Waiting for hosted model resources to be reclaimed
Waiting on 12 models, 4 machines, 4 applications
Waiting on 2 models, 4 machines, 4 applications
Waiting on 2 models, 4 machines, 4 applications
..continues on forever
```

Output from the machine-0 log: https://paste.ubuntu.com/20215065/

This seems to happen only on localhost (honestly it's what i test the most but i haven't seen it with aws)

lxc list just shows a bunch of running containers:

```
ubuntu@tupac:~/conjure$ lxc list
+---------------+---------+--------------------+------+------------+-----------+
| NAME | STATE | IPV4 | IPV6 | TYPE | SNAPSHOTS |
+---------------+---------+--------------------+------+------------+-----------+
| juju-88164f-0 | RUNNING | 10.1.78.148 (eth0) | | PERSISTENT | 0 |
+---------------+---------+--------------------+------+------------+-----------+
| juju-9e2de9-0 | RUNNING | 10.1.78.20 (eth0) | | PERSISTENT | 0 |
+---------------+---------+--------------------+------+------------+-----------+
| juju-c0f2ff-0 | RUNNING | 10.1.78.160 (eth0) | | PERSISTENT | 0 |
+---------------+---------+--------------------+------+------------+-----------+
| juju-c0f2ff-1 | RUNNING | 10.1.78.40 (eth0) | | PERSISTENT | 0 |
+---------------+---------+--------------------+------+------------+-----------+
| juju-c0f2ff-2 | RUNNING | 10.1.78.177 (eth0) | | PERSISTENT | 0 |
+---------------+---------+--------------------+------+------------+-----------+
| juju-c0f2ff-5 | RUNNING | 10.1.78.68 (eth0) | | PERSISTENT | 0 |
+---------------+---------+--------------------+------+------------+-----------+
| juju-c0f2ff-6 | RUNNING | 10.1.78.147 (eth0) | | PERSISTENT | 0 |
+---------------+---------+--------------------+------+------------+-----------+
| juju-c0f2ff-7 | RUNNING | 10.1.78.161 (eth0) | | PERSISTENT | 0 |
+---------------+---------+--------------------+------+------------+-----------+
| juju-c0f2ff-8 | RUNNING | 10.1.78.179 (eth0) | | PERSISTENT | 0 |
+---------------+---------+--------------------+------+------------+-----------+
```

tags: added: conjure
Revision history for this message
Tim Penhey (thumper) wrote :

Looking throught the logs, I found this twice.

2016-07-20 18:48:03 ERROR juju.state cleanup.go:121 cleanup failed: unit has storage attachments

This would cause the applications to be held open / not dead. We should check the cleanup code for units.

Changed in juju-core:
status: New → Triaged
importance: Undecided → Critical
milestone: none → 2.0-beta13
Tim Penhey (thumper)
Changed in juju-core:
milestone: 2.0-beta13 → 2.0-beta14
Changed in juju-core:
assignee: nobody → Ian Booth (wallyworld)
Ian Booth (wallyworld)
Changed in juju-core:
status: Triaged → In Progress
Larry Michel (lmic)
tags: added: oil oil-2.0
Revision history for this message
Larry Michel (lmic) wrote :

Attaching logs from bootstrap node for this failure that we hit:

+ juju kill-controller --yes ci-oil-slave2
Destroying controller "ci-oil-slave2"
Waiting for resources to be reclaimed
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model, 1 application
Waiting on 1 model
Waiting on 1 model
Waiting on 1 model
Waiting on 1 model
< Waiting on 1 model keeps repeating until build is killed>

Revision history for this message
Larry Michel (lmic) wrote :

There's bug 1566426 that we've also updated with the logs. If the two are being treated as separate issues, then you can disregard those logs from comment #2. Btw, the logs are for beta13 and that issue was also observed on beta11.

Andrew Wilkins (axwalk)
Changed in juju-core:
status: In Progress → Fix Committed
Curtis Hovey (sinzui)
Changed in juju-core:
status: Fix Committed → Fix Released
affects: juju-core → juju
Changed in juju:
milestone: 2.0-beta14 → none
milestone: none → 2.0-beta14
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Bug attachments

Remote bug watches

Bug watches keep track of this bug in other bug trackers.