‘limit’ in allocation_candidates where sometimes make force_hosts invalid

'No hosts matched due to not matching ...' in logs let me confused and should correct it.

Fix proposed to branch: master
Review: https://review.openstack.org/576693

I was going to suggest that one way to address this might be to use a nova-scheduler request filter to narrow the query space that is being looked at when querying placement. However we don't currently support an `rp_uuid=in:{uuid},{uuid},{uuid}` parameter on GET /allocation_candidates

As I recall 'force_hosts' has plenty of other problems too?

We would have this same problem with rebuild if we need to go through the scheduler again (in case the image changes during rebuild). So yeah we likely need a pre-filter on this, and it was discussed in this spec:

https://specs.openstack.org/openstack/nova-specs/specs/rocky/approved/glance-image-traits.html

See the "Dealing with rebuild" sections.

Agreed in the scheduler meeting [1]:

In Stein, add a placement microversion to allow specifying provider UUID(s) to GET /allocation_candidates.

In Rocky, backportable, disable limit if force_host is set.

[1] http://eavesdrop.openstack.org/meetings/nova_scheduler/2018/nova_scheduler.2018-06-25-14.02.log.html#l-28

To summarize some of the conversation related to the planned fix for stein, where something like `uuid=in:{uuid},{uuid}` would be added:

The challenge with this is determining which resource providers those uuids would match. In a nested or sharing scenario, we presumably don't want to require (since we may not even know them) that all the resource provider uuids in the collection of allocations for this one vm be represented in the in `uuid` parameter.

We could make it so that the uuids are only "anchor" providers, which means in the "force_hosts" case the uuids of the resource providers representing the hosts being targeted would be listed in the parameter.

This makes some logical sense, but may be a nova-ism.

It's also not clear if the idea of an "anchor" or "target" is sufficiently clear in the database query code to be able to do the equivalent of "where anchor.uuid in(uuids_from_param)".

Reviewed: https://review.openstack.org/576693
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=1d91811ad499af1d291f5c819ced5b1fdf3520c7
Submitter: Zuul
Branch: master

commit 1d91811ad499af1d291f5c819ced5b1fdf3520c7
Author: xulei <email address hidden>
Date: Wed Jun 20 13:15:46 2018 +0800

    Disable limits if force_hosts or force_nodes is set

    Setting max_placement_results will make force_host invaild sometimes,
    especially in large-scale enviroment.
    Disable limit param in GET /allocation_candidates if force_hosts
    or force_nodes is set.

    Change-Id: Iff1b49fe7e6347e3c2bb5992494b2450809719a2
    Closes-Bug: #1777591

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/584616

This issue was fixed in the openstack/nova 18.0.0.0b3 development milestone.

Reviewed: https://review.openstack.org/584616
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=ab1fd87ed9563ce8cf865ff539916e5d804853dc
Submitter: Zuul
Branch: stable/queens

commit ab1fd87ed9563ce8cf865ff539916e5d804853dc
Author: xulei <email address hidden>
Date: Wed Jun 20 13:15:46 2018 +0800

    Disable limits if force_hosts or force_nodes is set

    Setting max_placement_results will make force_host invaild sometimes,
    especially in large-scale enviroment.
    Disable limit param in GET /allocation_candidates if force_hosts
    or force_nodes is set.

    NOTE(xulei): There are differences from the original change because
    I496e8d64907fdcb0e2da255725aed1fc529725f2 was not in stable/queens,
    so we transplant code to get_allocation_candidates in this backport.

    Change-Id: Iff1b49fe7e6347e3c2bb5992494b2450809719a2
    Closes-Bug: #1777591
    (cherry picked from commit 1d91811ad499af1d291f5c819ced5b1fdf3520c7)

This issue was fixed in the openstack/nova 17.0.6 release.

Reviewed: https://review.opendev.org/649535
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=575fd08e63119900969d1f6784034772c7ab450b
Submitter: Zuul
Branch: master

commit 575fd08e63119900969d1f6784034772c7ab450b
Author: Tetsuro Nakamura <email address hidden>
Date: Tue Apr 2 08:27:49 2019 +0000

    Query `in_tree` to placement

    This patch adds the translation of `RequestGroup.in_tree` to the
    actual placement query and bumps microversion to enable it.

    The release note for this change is added.

    Change-Id: I8ec95d576417c32a57aa0298789dac6afb0cca02
    Blueprint: use-placement-in-tree
    Related-Bug: #1777591