Autopilot Log Analyser

  1. Bug #1661392
  2. Comment #0

Comment 0 for bug 1661392

Revision history for this message
Francis Ginther (fginther) wrote : "no image metadata found" during test_juju_bootstrap_kvm

Found this in our CI:
https://ci.lscape.net/job/landscape-system-tests/5178
https://ci.lscape.net/job/landscape-system-tests/5174

The symptom is that the test_juju_bootstrap_kvm test which attempts a juju bootstrap on the autopilot cloud is failing with:

INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:57:59 INFO cmd cmd.go:141 Loading image metadata
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:57:59 DEBUG juju.environs imagemetadata.go:112 obtained image datasource "keystone catalog"
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:57:59 DEBUG juju.environs imagemetadata.go:112 obtained image datasource "default cloud images"
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:57:59 DEBUG juju.environs imagemetadata.go:112 obtained image datasource "default ubuntu cloud images"
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:57:59 DEBUG juju.environs.bootstrap bootstrap.go:575 constraints for image metadata lookup &{{{region1 http://10.96.54.253:5000/v2.0} [win2008r2 win2012hvr2 win2016nano genericlinux win2012r2 win2016 win81 precise raring saucy trusty yakkety win2012 quantal vivid wily xenial win8 win10 centos7 utopic zesty win2012hv win7] [amd64 i386 armhf arm64 ppc64el s390x] released}}
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:57:59 DEBUG juju.environs.simplestreams simplestreams.go:454 skipping index "http://10.96.54.252:80/swift/v1/simplestreams/data/streams/v1/index.json" because of missing information: index file has no data for cloud {region1 http://10.96.54.253:5000/v2.0} not found
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:57:59 DEBUG juju.environs.bootstrap bootstrap.go:583 ignoring image metadata in keystone catalog: index file has no data for cloud {region1 http://10.96.54.253:5000/v2.0} not found
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:00 DEBUG juju.environs.bootstrap bootstrap.go:587 found 0 image metadata in default cloud images
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:01 DEBUG juju.environs.simplestreams simplestreams.go:454 skipping index "http://cloud-images.ubuntu.com/releases/streams/v1/index.sjson" because of missing information: index file has no data for cloud {region1 http://10.96.54.253:5000/v2.0} not found
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:01 DEBUG juju.environs.bootstrap bootstrap.go:583 ignoring image metadata in default ubuntu cloud images: index file has no data for cloud {region1 http://10.96.54.253:5000/v2.0} not found
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:01 DEBUG juju.environs.bootstrap bootstrap.go:591 found 0 image metadata from all image data sources
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:01 INFO juju.provider.common destroy.go:20 destroying model "controller"
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:01 INFO juju.provider.common destroy.go:31 destroying instances
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:05 DEBUG juju.provider.openstack provider.go:1127 terminating instances []
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:05 DEBUG goose <autogenerated>:22 performing API version discovery for "http://10.96.55.3:9696/"
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:05 WARN goose <autogenerated>:38 discovered API versions: [{Version:{major:2 minor:0} Links:[{Href:http://10.96.55.3:9696/v2.0 Rel:self}] Status:CURRENT}]
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:05 INFO juju.provider.common destroy.go:51 destroying storage
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:05 DEBUG juju.provider.openstack cinder.go:81 volume URL: http://10.96.55.7:8776/v2/9584f0d124494d2db439687e461dc2c2
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:09 ERROR cmd supercommand.go:458 failed to bootstrap model: no image metadata found
INFO ui.openstack.test_region_juju_bootstrap.RegionBootstrapTest.test_juju_bootstrap_kvm . 16:58:09 DEBUG cmd supercommand.go:459 (error details: [{github.com/juju/juju/cmd/juju/commands/bootstrap.go:565: failed to bootstrap model} {github.com/juju/juju/environs/bootstrap/bootstrap.go:244: } {github.com/juju/juju/environs/bootstrap/bootstrap.go:593: no image metadata found}])

or simply "no image metadata found".

(a nicer pastebin is here: https://pastebin.canonical.com/178052/)

I took a closer look at 5178 and it appears that glance-simplestreams-sync uploaded the "16.04 LTS" image to glance at 16:09:27. Logs from this run are attached.

Will try to catch this on a live system.