Hadoop with auto security group not working

Bug #1394988 reported by Sergey Reshetnyak
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Sahara
Fix Released
Critical
Sergey Reshetnyak
Juno
Fix Released
Critical
Nikita Konovalov

Bug Description

ENV:
OpenStack with Neutron

Steps to reproduce:
1. Create cluster with auto security groups and two or more nodemanagers.
2. Launch pig job with 1Gb input data

Result:
After ~1 hour job in KILLED state.

Reproduced with the following plugins:
Vanilla 2
HDP 2
CDH

description: updated
Revision history for this message
Sergey Reshetnyak (sreshetniak) wrote :

YARN containers bind on any ephemeral ports.
Open all ports in private network solve this problem.

Changed in sahara:
status: Confirmed → In Progress
Revision history for this message
Robert Clark (robert-clark) wrote :

By ephemeral do you mean random ?

Revision history for this message
Andrew Lazarev (alazarev) wrote :

We really need distinguish private and management networks for auto security groups.

Changed in sahara:
importance: High → Critical
Revision history for this message
Matthew Farrellee (mattf) wrote :

@robert-clark ephemeral has a specific meaning and is more than random. an ephemeral port is guaranteed by the kernel to not be in use.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to sahara (master)

Reviewed: https://review.openstack.org/136083
Committed: https://git.openstack.org/cgit/openstack/sahara/commit/?id=7c4ea57548c34a84996ba36fbdf6d63b17bf6cf3
Submitter: Jenkins
Branch: master

commit 7c4ea57548c34a84996ba36fbdf6d63b17bf6cf3
Author: Sergey Reshetnyak <email address hidden>
Date: Thu Nov 20 21:15:45 2014 +0300

    Open all ports for private network for auto SG

    Closes-bug: #1394988

    Change-Id: I07485c286a501bff52f8c67ffd0cc841814a5c9c

Changed in sahara:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in sahara:
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to sahara (stable/juno)

Fix proposed to branch: stable/juno
Review: https://review.openstack.org/150823

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to sahara (stable/juno)

Reviewed: https://review.openstack.org/150823
Committed: https://git.openstack.org/cgit/openstack/sahara/commit/?id=ebb865d2ec9ece72dc41f285143cf2cf4ae405e6
Submitter: Jenkins
Branch: stable/juno

commit ebb865d2ec9ece72dc41f285143cf2cf4ae405e6
Author: Sergey Reshetnyak <email address hidden>
Date: Thu Nov 20 21:15:45 2014 +0300

    Open all ports for private network for auto SG

    Closes-bug: #1394988

    Change-Id: I07485c286a501bff52f8c67ffd0cc841814a5c9c
    (cherry picked from commit 7c4ea57548c34a84996ba36fbdf6d63b17bf6cf3)

Thierry Carrez (ttx)
Changed in sahara:
milestone: kilo-1 → 2015.1.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.