Nova isn't using rbd direct snapshot when config Nova, Glance to use Ceph storage

Bug #1641815 reported by Yaguang Tang
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Yaguang Tang
Mitaka
Fix Released
High
Oleksiy Molchanov
Newton
Fix Committed
High
Sergii Golovatiuk

Bug Description

Tested on MOS8.0, MOS 9.0

When using Ceph as storage backend for Nova,Glance and Cinder, instance snapshot doesn't take the benefit of Ceph rbd direct snapshot which is implemented by this blueprint https://blueprints.launchpad.net/nova/+spec/rbd-instance-snapshots, the root cause is that Nova's compute user of ceph storage has no write permission on Glance's images pool of Ceph.

Here is output of a MOS 8 env:

root@node-5:~# ceph auth list
installed auth entries:

osd.0
        key: AQAYIyBYoTKRFhAA/hX+kv9Ifbi3D7siaWxiUQ==
        caps: [mon] allow profile osd
        caps: [osd] allow *
osd.1
        key: AQAZIyBY+DzzIRAA4pRFbyZbOk4YluBcSDxc/g==
        caps: [mon] allow profile osd
        caps: [osd] allow *
osd.2
        key: AQAZIyBYUaFkIhAAXi0JqyzeOPcJtKu/im8+2w==
        caps: [mon] allow profile osd
        caps: [osd] allow *
osd.3
        key: AQAdIyBYYrvXHhAACMy/FVEGQjc/1eJ9dYbUAw==
        caps: [mon] allow profile osd
        caps: [osd] allow *
osd.4
        key: AQAfIyBYRJ4RAxAADRe0f9fL02jM8eYB+4fFiA==
        caps: [mon] allow profile osd
        caps: [osd] allow *
osd.5
        key: AQAoIyBYo2G1ARAAJFmruttfAWowpJ5jDRD8YA==
        caps: [mon] allow profile osd
        caps: [osd] allow *
osd.6
        key: AQAnIyBYxTWmOhAARt8PgeKacXkI46DcnGV/Ug==
        caps: [mon] allow profile osd
        caps: [osd] allow *
osd.7
        key: AQAsIyBYiPM3JRAAB6pqrrn3t4/sasCcEGOQlw==
        caps: [mon] allow profile osd
        caps: [osd] allow *
osd.8
        key: AQA2IyBY1OEsGRAAJK/ByRLpePiIKkyM4iNpBw==
        caps: [mon] allow profile osd
        caps: [osd] allow *
client.admin
        key: AQCbFiBYFpAPLhAAHHiuziNMdYvFi2ntYA3d4Q==
        caps: [mds] allow
        caps: [mon] allow *
        caps: [osd] allow *
client.backups
        key: AQBoJCBYFMazNBAApsoqmuSwGJk62GFk/VwG/w==
        caps: [mon] allow r
        caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=backups, allow rwx pool=volumes
client.bootstrap-mds
        key: AQCcFiBYzGe4GxAAEqHfAlZHhEF5/I8bCokrOg==
        caps: [mon] allow profile bootstrap-mds
client.bootstrap-osd
        key: AQCcFiBYUiXPABAAV7h+FzcgLBuWAjm4AkspBg==
        caps: [mon] allow profile bootstrap-osd
client.bootstrap-rgw
        key: AQCcFiBYEjI3DxAAL5Xgu31flbbSZq4HuXuxRg==
        caps: [mon] allow profile bootstrap-rgw
client.compute
        key: AQChJCBYmX6zORAAQkjpehi/Zu5tgaH0u9vlpg==
        caps: [mon] allow r
        caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=volumes, allow rx pool=images, allow rwx pool=compute
client.images
        key: AQBmJCBY/xp7ABAAVeNRf/312lAGyIf2e5eZkw==
        caps: [mon] allow r
        caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=images
client.radosgw.gateway
        key: AQCxFiBYhoqDIxAACJ+URYYxnZJUuOvE445zBQ==
        caps: [mon] allow rw
        caps: [osd] allow rwx
client.volumes
        key: AQBnJCBYw8GyBBAAsPsOlbRE4DRHt0kIBCuoqw==
        caps: [mon] allow r
        caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=volumes, allow rx pool=images

Tags: area-library
Changed in fuel:
assignee: nobody → Yaguang Tang (heut2008)
status: New → In Progress
Changed in fuel:
milestone: none → 11.0
importance: Undecided → Medium
importance: Medium → High
tags: added: area-library
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/newton)

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/405062

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/397551
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=129fbe2a8f522bbe2ae96c1b23229b1fe3967c6c
Submitter: Jenkins
Branch: master

commit 129fbe2a8f522bbe2ae96c1b23229b1fe3967c6c
Author: Yaguang Tang <email address hidden>
Date: Tue Nov 15 14:33:52 2016 +0800

    Grant Compute user write permission to Glance images pool

    Nova has implemented instance rbd snapshot feature to reduce snapshot
    time, to use this feature, Nova requires write permission to Glance
    images pool.

    Closes-Bug: #1641815

    Change-Id: I0d57d3fb352c68309432084c68d1d24e4f6ce8b6

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/newton)

Reviewed: https://review.openstack.org/405062
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=e02f1b4cd70bff705bc5f187df042f5ff2388687
Submitter: Jenkins
Branch: stable/newton

commit e02f1b4cd70bff705bc5f187df042f5ff2388687
Author: Yaguang Tang <email address hidden>
Date: Tue Nov 15 14:33:52 2016 +0800

    Grant Compute user write permission to Glance images pool

    Nova has implemented instance rbd snapshot feature to reduce snapshot
    time, to use this feature, Nova requires write permission to Glance
    images pool.

    Closes-Bug: #1641815

    Change-Id: I0d57d3fb352c68309432084c68d1d24e4f6ce8b6

Revision history for this message
Dmitry Pyzhov (dpyzhov) wrote :

@Yaguang, could you create backport for stable/mitaka branch, please?

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/407410

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/mitaka)

Reviewed: https://review.openstack.org/407410
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=d891b4fd30677acb112e7e6b26e36e5c267028cf
Submitter: Jenkins
Branch: stable/mitaka

commit d891b4fd30677acb112e7e6b26e36e5c267028cf
Author: Yaguang Tang <email address hidden>
Date: Tue Dec 6 16:43:25 2016 +0800

    Grant Compute user write permission to Glance images pool

    Nova has implemented instance rbd snapshot feature to reduce snapshot
    time, to use this feature, Nova requires write permission to Glance
    images pool.

    Closes-Bug: #1641815

    Change-Id: I0d57d3fb352c68309432084c68d1d24e4f6ce8b6

tags: added: on-verification
Revision history for this message
Ekaterina Shutova (eshutova) wrote :

Verified on 9.2 snapshot #650.

tags: removed: on-verification
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/fuel-library 11.0.0.0rc1

This issue was fixed in the openstack/fuel-library 11.0.0.0rc1 release candidate.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.