Cinder

Random Bad Request Responses from Cinder API calls

Bug #1383771 reported by John Griffith on 2014-10-21

This bug affects 2 people

Affects		Status	Importance	Assigned to	Milestone
	Cinder	New	Wishlist	Unassigned

Bug Description

Randomly receive 400 responses from Cinder API when trying to do things like delete volumes.

jgriffith@trusty ~ $ cinder delete 44f832a6-f759-4d69-b608-7b2579bc8e41 793235c6-93fb-4a44-8d37-1f89ee2e5b09
Delete for volume 44f832a6-f759-4d69-b608-7b2579bc8e41 failed: Bad Request (HTTP 400) (Request-ID: req-168c53e1-49b3-4b63-aac6-acc0f082f266)
Delete for volume 793235c6-93fb-4a44-8d37-1f89ee2e5b09 failed: Bad Request (HTTP 400) (Request-ID: req-0eea913f-cf2d-4756-ba0c-4611c9231581)
ERROR: Unable to delete any of specified volumes.

Although the volumes are there:

Problem is that these volumes are STUCK in migration_status=completing and essentialy locked. There's no indication available of this other than going into the database and inspecting things.

Tags:

Revision history for this message

Duncan Thomas (duncan-thomas) wrote on 2014-10-21:

Yuck

Revision history for this message

Liusheng (liusheng) wrote on 2014-11-03:

https://review.openstack.org/#/c/132542/

Changed in cinder:
status:	Triaged → In Progress

Mike Perez (thingee) on 2014-11-25

Changed in cinder:
assignee:	nobody → Liusheng (liusheng)

Revision history for this message

Rushi Agrawal (rushiagr) wrote on 2014-11-27:

Just for info, the oslo patch has been merged. Please close this bug if the problems are no more visible. I'm not very sure the oslo patch solves everything, so..

Mike Perez (thingee) on 2014-12-09

Changed in cinder:
assignee:	Liusheng (liusheng) → nobody
milestone:	kilo-1 → kilo-2

Mike Perez (thingee) on 2015-02-02

tags:	removed: icehouse-backport-potential juno-backport-potential
Changed in cinder:
status:	In Progress → New
milestone:	kilo-2 → kilo-3
milestone:	kilo-3 → none

Revision history for this message

Praveen N (praveenn) wrote on 2015-03-24:

Just for information; there are much discussions on ask.openstack.org about the issues concerning
cinder delete $volumeid

Revision history for this message

NidhiMittalHada (nidhimittal19) wrote on 2015-05-13:

HI All,

I tested this bug in
stack@controller:~/devstack$ openstack --version
openstack 1.2.0

when a volume is being migrated ..
stack@controller:~/devstack$ cinder show 3ee38bf8-9982-4181-a78e-17d522ffd335

+------------- | Property +------------- | attachments | availability_zone | bootable | created_at | display_description | display_name | encrypted | id | metadata | multiattach | os-vol- +---------------------------------------+--------------------------------------+
| Value |
/>--------------------------+--------------------------------------+
| [] |
| nova |
| false |
| 2015-05-11T15:26:47.000000 |
| First Test volume |
| volume1 |
| False |
| 3ee38bf8-9982-4181-a78e-17d522ffd335 |
| {} |
| false |
/>host-attr:host | controller@lvmdriver-1#GOLD_BKEND |
/>mig-status-attr:migstat | migrating |>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
/>mig-status-attr:name_id | None |
/>tenant-attr:tenant_id | eeeb98b1ea5b4caca29b515696f53f62 |
/>replication:driver_data | None |
/>replication:extended_status | None |
| 1 |
| None |
| None |
| available |
| None |
/>--------------------------+--------------------------------------+

stack@controller:~/devstack$ cinder delete 3ee38bf8-9982-4181-a78e-17d522ffd335

Delete for volume 3ee38bf8-9982-4181-a78e-17d522ffd335 failed: Invalid volume: Volume cannot be deleted while migrating (HTTP 400) (Request-ID: req-47552db4-4acc-41b0-96df-79f87a8436c9)
ERROR: Unable to delete any of the specified volumes.

Which is a clear indication that volume can not be deleted as its in migrating state.

Hence this bug can be closed.

HI All,

I tested this bug in 
stack@controller:~/devstack$ openstack --version
openstack 1.2.0

when a volume is being migrated ..
stack@controller:~/devstack$ cinder show 3ee38bf8-9982-4181-a78e-17d522ffd335

+---------------------------------------+--------------------------------------+
|                Property               |                Value                 |
+---------------------------------------+--------------------------------------+
|              attachments              |                  []                  |
|           availability_zone           |                 nova                 |
|                bootable               |                false                 |
|               created_at              |      2015-05-11T15:26:47.000000      |
|          display_description          |          First Test volume           |
|              display_name             |               volume1                |
|               encrypted               |                False                 |
|                   id                  | 3ee38bf8-9982-4181-a78e-17d522ffd335 |
|                metadata               |                  {}                  |
|              multiattach              |                false                 |
|         os-vol-host-attr:host         |  controller@lvmdriver-1#GOLD_BKEND   |
|     os-vol-mig-status-attr:migstat    |              migrating               |>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|     os-vol-mig-status-attr:name_id    |                 None                 |
|      os-vol-tenant-attr:tenant_id     |   eeeb98b1ea5b4caca29b515696f53f62   |
|   os-volume-replication:driver_data   |                 None                 |
| os-volume-replication:extended_status |                 None                 |
|                  size                 |                  1                   |
|              snapshot_id              |                 None                 |
|              source_volid             |                 None                 |
|                 status                |              available               |
|              volume_type              |                 None                 |
+---------------------------------------+--------------------------------------+

stack@controller:~/devstack$ cinder delete 3ee38bf8-9982-4181-a78e-17d522ffd335

Which is a clear indication that volume can not be deleted as its in migrating state.

Hence this bug can be closed.

zwei (suifeng20) on 2016-03-07

Changed in cinder:
assignee:	nobody → zwei (suifeng20)

Revision history for this message

Duncan Thomas (duncan-thomas) wrote on 2016-03-07:

It would be nice if the delete caused the migration to be cancelled - there's no point continuing to do work on a volume that is no longer wanted

Changed in cinder:
importance:	High → Wishlist

Revision history for this message

Duncan Thomas (duncan-thomas) wrote on 2016-03-07:

Changed to wishlist since the error is now sensible, and the change to make the delete cancel the migration is a feature enhancement

Revision history for this message

Sean McGinnis (sean-mcginnis) wrote on 2016-10-07: Owner Expired

Unassigning due to no activity.

Changed in cinder:
assignee:	zwei (suifeng20) → nobody

Kendall Nelson (kjnelson) on 2017-05-16

tags:

added: api

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.