master-pkg-systest-centos: failed error_setup_master method

Bug #1606958 reported by Alexey Golubev
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Fuel CI

Bug Description

https://packaging-ci.infra.mirantis.net/job/master-pkg-systest-centos/1168:

2016-07-27 12:35:38,862 - INFO decorators.py:314 -- <<<<<****************************************************************************************************>>>>>
2016-07-27 12:35:38,863 - INFO decorators.py:315 -- Failed in method error_setup_master. Make snapshot: error_setup_master
2016-07-27 12:35:38,863 - INFO decorators.py:325 -- You could revert and ssh to master node: [source /home/jenkins/venv-nailgun-tests-2.9/bin/activate; dos.py revert-resume master-pkg-systest-centos-centos7.1168.1168 error_setup_master && ssh root@10.109.15.2]
2016-07-27 12:35:38,863 - INFO decorators.py:327 -- <<<<<****************************************************************************************************>>>>>
2016-07-27 12:35:38,864 - ERROR decorators.py:123 -- Traceback (most recent call last):
  File "/home/jenkins/workspace/master-pkg-systest-centos/fuel-qa/fuelweb_test/helpers/decorators.py", line 117, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/master-pkg-systest-centos/fuel-qa/fuelweb_test/tests/base_test_case.py", line 338, in setup_master
    self.env.setup_environment()
  File "/home/jenkins/workspace/master-pkg-systest-centos/fuel-qa/fuelweb_test/models/environment.py", line 416, in setup_environment
    self.wait_bootstrap()
  File "/home/jenkins/workspace/master-pkg-systest-centos/fuel-qa/fuelweb_test/models/environment.py", line 533, in wait_bootstrap
    self.bootstrap_image_check()
  File "/home/jenkins/workspace/master-pkg-systest-centos/fuel-qa/fuelweb_test/models/environment.py", line 564, in bootstrap_image_check
    'Ubuntu bootstrap image wasn\'t built and activated! '
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/asserts.py", line 163, in assert_true
    raise ASSERTION_ERROR(message)
AssertionError: Ubuntu bootstrap image wasn't built and activated! See logs in /var/log/fuel-bootstrap-image-build.log for details.

Revision history for this message
Alexander Kislitsky (akislitsky) wrote :

Seems that we've missed packages:

Stderr: 'E: Unable to locate package nailgun-agent\nE: Unable to locate package nailgun-mcagents\nE: Unable to locate package fuel-agent\nE: Unable to locate package hpsa-dkms\n'
Traceback (most recent call last):
  File "/bin/fuel-bootstrap", line 10, in <module>
    sys.exit(main())
  File "/usr/lib/python2.7/site-packages/fuel_bootstrap/main.py", line 57, in main
    return FuelBootstrap().run(argv)
  File "/usr/lib/python2.7/site-packages/cliff/app.py", line 226, in run
    result = self.run_subcommand(remainder)
  File "/usr/lib/python2.7/site-packages/cliff/app.py", line 346, in run_subcommand
    result = cmd.run(parsed_args)
  File "/usr/lib/python2.7/site-packages/cliff/command.py", line 55, in run
    self.take_action(parsed_args)
  File "/usr/lib/python2.7/site-packages/fuel_bootstrap/commands/build.py", line 177, in take_action
    image_uuid, path = bs_image.make_bootstrap(vars(parsed_args))
  File "/usr/lib/python2.7/site-packages/fuel_bootstrap/utils/bootstrap_image.py", line 174, in make_bootstrap
    mngr.do_mkbootstrap()
  File "/usr/lib/python2.7/site-packages/fuel_agent/manager.py", line 1030, in do_mkbootstrap
    attempts=CONF.fetch_packages_attempts)
  File "/usr/lib/python2.7/site-packages/fuel_agent/utils/build.py", line 115, in run_apt_get
    stdout, stderr = utils.execute(*cmds, attempts=attempts)
  File "/usr/lib/python2.7/site-packages/fuel_agent/utils/utils.py", line 140, in execute
    stderr=stderr, cmd=command)
fuel_agent.errors.ProcessExecutionError: Unexpected error while running command.
Command: chroot /tmp/tmpFVVvs8.fuel-agent-image apt-get -y install squashfs-tools nailgun-agent nailgun-mcagents live-boot openssh-server i40e-dkms vim fuel-agent mcollective xz-utils msmtp-mta wget hpsa-dkms multipath-tools-boot multipath-tools hwloc openssh-client mc ntp linux-firmware linux-firmware-nonfree network-checker live-boot-initramfs-tools linux-headers-generic linux-image-generic-lts-trusty ubuntu-minimal
Exit code: 100
Stdout: 'Reading package lists...\nBuilding dependency tree...\nReading state information...\n'
Stderr: 'E: Unable to locate package nailgun-agent\nE: Unable to locate package nailgun-mcagents\nE: Unable to locate package fuel-agent\nE: Unable to locate package hpsa-dkms\n'

Changed in fuel:
assignee: nobody → Fuel build team (fuel-build)
Revision history for this message
Roman Vyalov (r0mikiam) wrote :

Reassign to mos-linux team , because this task related to the master packages for Newton

Changed in fuel:
milestone: none → 10.0
assignee: Fuel build team (fuel-build) → MOS Packaging Team (mos-packaging)
assignee: MOS Packaging Team (mos-packaging) → MOS Linux (mos-linux)
Revision history for this message
Dmitry Teselkin (teselkin-d) wrote :

The ISO used in systest was built by 10.0 job [1]. Those ISOs are unstable until moved to Xenial completely. This process isn't finished yet.

We should either use 10.0-mitaka ISO or switch to Xenial completely.

[1] https://product-ci.infra.mirantis.net/view/10.0/job/10.0.all/

Changed in fuel:
status: New → Confirmed
importance: Undecided → High
Revision history for this message
Dmitry Teselkin (teselkin-d) wrote :

Was fixed with switching to Ubuntu Xenial in 10.0.
Community ISO doesn't produce such errors and is used during systest runs.

Changed in fuel:
status: Confirmed → Invalid
status: Invalid → Confirmed
Revision history for this message
Dmitry Teselkin (teselkin-d) wrote :

Building bootstrap image is broken because it uses trusty snapshot, instead of xenial.
CI team, please switch this job to Xenial snapshots.

Changed in fuel:
assignee: MOS Linux (mos-linux) → Fuel CI (fuel-ci)
Revision history for this message
Ivan (iremizov) wrote :

Set status to new because bug didn't pass through triage process.

@teselkin-d, please never reassign bug to other teams in confirmed state.

Changed in fuel:
status: Confirmed → New
Revision history for this message
Ivan (iremizov) wrote :

24.08.2016 0:09:00
Canary build
https://packaging-ci.infra.mirantis.net/job/master-pkg-systest-centos/1431/
is green

24.08.2016 9:41:29
Build for review 25164,1
https://packaging-ci.infra.mirantis.net/job/master-pkg-systest-centos/1432/
is green

24.08.2016 10:36:07
Build for review 25297,2
https://packaging-ci.infra.mirantis.net/job/master-pkg-systest-centos/1433/
is green

In logs of these jobs there are no trusty mentions. There is xenial used.
So I suppose that everything was fixed by 24.08.2016

Changed in fuel:
status: New → Fix Committed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.