Fuel for OpenStack

no disk information leading to error during node allocation

  1. Series 4.1.x
  2. Bug #1306491
Bug #1306491 reported by sbartel
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Ihor Kalnytskyi
Fuel for OpenStack 5.0
4.1.x
Fix Committed
High
Ihor Kalnytskyi
Fuel for OpenStack 4.1.1
5.0.x
Fix Committed
High
Ihor Kalnytskyi
Fuel for OpenStack 5.0

Bug Description

Hello,

We are trying to create a HA environment with ubuntu release.
the architecture of the plateform is :
3 servers IBM System x3550 -[7978B9G]-
1 server IBM System x3550 M3 -[7944W6B]-
4 HP Proliant BL680c G5

each server has the same network configuration :
eth0 trunked : public and admin
eth1 not trunked : pxe
eth2 trunked : storage network

during the nodes discovery, it seems there is a problem with the 3 servers IBM System x3550 -[7978B9G]-
they are seen with no disk : Disks 0 drives, 0 bytes total

where as when connecting on the node with ssh from the fuel master node we've got the following result for 'fdisk -l' command:
Disk /dev/sda: 73.3 GB, 73283928064 bytes
255 heads, 63 sectors/track, 8909 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x0009ea9c

   Device Boot Start End Blocks Id System
/dev/sda1 * 1 3891 31249408 83 Linux
/dev/sda2 7083 8910 14678017 5 Extended
/dev/sda3 3891 7083 25636863 8e Linux LVM
Partition 3 does not end on cylinder boundary.
/dev/sda5 7083 8910 14678016 82 Linux swap / Solaris

Partition table entries are not in disk order

So there is a disk on the server

So when we try to add them to the environnement we've got the following error
2014-04-11 07:44:30 ERROR [7f907ffff700] (logger) Response code '500 Internal Server Error' for PUT /api/nodes/ from 10.20.1.246:58840

2014-04-11 07:44:30 ERROR [7f907ffff700] (logger) Traceback (most recent call last):
  File "/opt/nailgun/lib/python2.6/site-packages/web/application.py", line 239, in process
    return self.handle()
  File "/opt/nailgun/lib/python2.6/site-packages/web/application.py", line 230, in handle
    return self._delegate(fn, self.fvars, args)
  File "/opt/nailgun/lib/python2.6/site-packages/web/application.py", line 420, in _delegate
    return handle_class(cls)
  File "/opt/nailgun/lib/python2.6/site-packages/web/application.py", line 396, in handle_class
    return tocall(*args)
  File "<string>", line 2, in PUT
  File "/opt/nailgun/lib/python2.6/site-packages/nailgun/api/handlers/base.py", line 62, in content_json
    data = func(*args, **kwargs)
  File "/opt/nailgun/lib/python2.6/site-packages/nailgun/api/handlers/node.py", line 385, in PUT
    node.volume_manager.gen_volumes_info()
  File "/opt/nailgun/lib/python2.6/site-packages/nailgun/volumes/manager.py", line 843, in gen_volumes_info
    min_size = self.expand_generators(volume)['min_size']
  File "/opt/nailgun/lib/python2.6/site-packages/nailgun/volumes/manager.py", line 907, in expand_generators
    for (k, v) in value.iteritems())
  File "/opt/nailgun/lib/python2.6/site-packages/nailgun/volumes/manager.py", line 907, in <genexpr>
    for (k, v) in value.iteritems())
  File "/opt/nailgun/lib/python2.6/site-packages/nailgun/volumes/manager.py", line 900, in expand_generators
    generator, *generator_args)
  File "/opt/nailgun/lib/python2.6/site-packages/nailgun/volumes/manager.py", line 714, in call_generator
    result = generators[generator](*args)
  File "/opt/nailgun/lib/python2.6/site-packages/nailgun/volumes/manager.py", line 704, in <lambda>
    lambda: generators['calc_root_size']() + \
  File "/opt/nailgun/lib/python2.6/site-packages/nailgun/volumes/manager.py", line 720, in _calc_root_size
    size = int(self.disks[0].size * 0.2)
IndexError: list index out of range

Revision history for this message
Oscar Larrayoz (olarrayoz) wrote :

Hello,

The problem is that the disks are detected as external (in ServeRaid controllers) and nailgun agent doesn't see them.

Workaround in Fuel 4.1:

ssh to the node:
vi /opt/nailgun/bin/agent
in REMOVABLE_VENDORS add "ServeRA",
exit

You need to do two times, one during bootstrap and another one after the operating system installation.

Mike Scherbakov (mihgen)
Changed in fuel:
milestone: none → 5.0
importance: Undecided → High
status: New → Triaged
tags: added: backports-4.1.1
Revision history for this message
sbartel (samuel-bartel) wrote : RE : [Bug 1306491] Re: no disk information leading to error during node allocation
Download full text (5.6 KiB)

Hello,

Do I need to reboot the node after the modification in nailgun agent?

________________________________________
De : <email address hidden> [<email address hidden>] de la part de Oscar Larrayoz [<email address hidden>]
Date d'envoi : vendredi 11 avril 2014 11:44
À : BARTEL Samuel NRS
Objet : [Bug 1306491] Re: no disk information leading to error during node allocation

Hello,

The problem is that the disks are detected as external (in ServeRaid
controllers) and nailgun agent doesn't see them.

Workaround in Fuel 4.1:

ssh to the node:
vi /opt/nailgun/bin/agent
in REMOVABLE_VENDORS add "ServeRA",
exit

You need to do two times, one during bootstrap and another one after the
operating system installation.

--
You received this bug notification because you are subscribed to the bug
report.
https://bugs.launchpad.net/bugs/1306491

Title:
  no disk information leading to error during node allocation

Status in Fuel: OpenStack installer that works:
  New

Bug description:
  Hello,

  We are trying to create a HA environment with ubuntu release.
  the architecture of the plateform is :
  3 servers IBM System x3550 -[7978B9G]-
  1 server IBM System x3550 M3 -[7944W6B]-
  4 HP Proliant BL680c G5

  each server has the same network configuration :
  eth0 trunked : public and admin
  eth1 not trunked : pxe
  eth2 trunked : storage network

  during the nodes discovery, it seems there is a problem with the 3 servers IBM System x3550 -[7978B9G]-
  they are seen with no disk : Disks 0 drives, 0 bytes total

  where as when connecting on the node with ssh from the fuel master node we've got the following result for 'fdisk -l' command:
  Disk /dev/sda: 73.3 GB, 73283928064 bytes
  255 heads, 63 sectors/track, 8909 cylinders
  Units = cylinders of 16065 * 512 = 8225280 bytes
  Sector size (logical/physical): 512 bytes / 512 bytes
  I/O size (minimum/optimal): 512 bytes / 512 bytes
  Disk identifier: 0x0009ea9c

     Device Boot Start End Blocks Id System
  /dev/sda1 * 1 3891 31249408 83 Linux
  /dev/sda2 7083 8910 14678017 5 Extended
  /dev/sda3 3891 7083 25636863 8e Linux LVM
  Partition 3 does not end on cylinder boundary.
  /dev/sda5 7083 8910 14678016 82 Linux swap / Solaris

  Partition table entries are not in disk order

  So there is a disk on the server

  So when we try to add them to the environnement we've got the following error
  2014-04-11 07:44:30 ERROR [7f907ffff700] (logger) Response code '500 Internal Server Error' for PUT /api/nodes/ from 10.20.1.246:58840

  2014-04-11 07:44:30 ERROR [7f907ffff700] (logger) Traceback (most recent call last):
    File "/opt/nailgun/lib/python2.6/site-packages/web/application.py", line 239, in process
      return self.handle()
    File "/opt/nailgun/lib/python2.6/site-packages/web/application.py", line 230, in handle
      return self._delegate(fn, self.fvars, args)
    File "/opt/nailgun/lib/python2.6/site-packages/web/application.py", line 420, in _delegate
      return handle_class(cls)
    File "/opt/nailgun/lib/python2.6/site-packages/web/application.py", line 396, in hand...

Read more...

Revision history for this message
Oscar Larrayoz (olarrayoz) wrote :

Hello,

No, only wait one or two minutes.

Dmitry Pyzhov (dpyzhov)
Changed in fuel:
assignee: nobody → Fuel Python Team (fuel-python)
Vladimir Kuklin (vkuklin)
tags: added: customer-found
Revision history for this message
Ihor Kalnytskyi (ikalnytskyi) wrote :

https://review.openstack.org/#/c/90750/

Changed in fuel:
assignee: Fuel Python Team (fuel-python) → Igor Kalnitsky (ikalnitsky)
status: Triaged → In Progress
Revision history for this message
Openstack Gerrit (openstack-gerrit) wrote : Fix merged to fuel-web (master)

Reviewed: https://review.openstack.org/90750
Committed: https://git.openstack.org/cgit/stackforge/fuel-web/commit/?id=0462e3e1929d776942e44fb02796b5bac5ee3c3d
Submitter: Jenkins
Branch: master

commit 0462e3e1929d776942e44fb02796b5bac5ee3c3d
Author: Igor Kalnitsky <email address hidden>
Date: Mon Apr 28 17:16:36 2014 +0300

    agent: add ServerRA to removable disk vendors

    Change-Id: If00038a5c6e93f981b2fa125ca94720774b04cb7
    Closes-Bug: 1306491

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-web (stable/4.1)

Fix proposed to branch: stable/4.1
Review: https://review.openstack.org/96105

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-web (stable/4.1)

Reviewed: https://review.openstack.org/96105
Committed: https://git.openstack.org/cgit/stackforge/fuel-web/commit/?id=f70a983b5f59489b5785c261d0cc4a1c9ffb065e
Submitter: Jenkins
Branch: stable/4.1

commit f70a983b5f59489b5785c261d0cc4a1c9ffb065e
Author: Igor Kalnitsky <email address hidden>
Date: Mon Apr 28 17:16:36 2014 +0300

    agent: add ServerRA to removable disk vendors

    Change-Id: If00038a5c6e93f981b2fa125ca94720774b04cb7
    Closes-Bug: 1306491

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.