[3.1.1.0-40~mitaka ] Tor Agent Crash in __GI___libc_sigaction

Bug #1642781 reported by chhandak
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R3.0
Fix Committed
High
Manish Singh
R3.1
Fix Committed
High
Manish Singh
R3.2
Fix Committed
High
Manish Singh
Trunk
Fix Committed
High
Manish Singh

Bug Description

Observed this crash with 3.1.1.0-40~mitaka

Backtrace
---------
Undefined command: "more". Try "help".
(gdb) bt
#0 0x00007f8a1ee95cc9 in __GI___libc_sigaction (sig=21211, act=0x5319, oact=0x6)
    at ../sysdeps/unix/sysv/linux/x86_64/sigaction.c:53
#1 0x00000000007c7167 in unlock (this=0x0) at /usr/include/tbb/mutex.h:197
#2 release (this=<synthetic pointer>) at /usr/include/tbb/mutex.h:127
#3 ~scoped_lock (this=<synthetic pointer>, __in_chrg=<optimized out>) at /usr/include/tbb/mutex.h:97
#4 TraceBuffer<SandeshTrace>::TraceWrite (this=0x7f8a1efdf830, trace_entry=<optimized out>)
    at controller/src/base/trace.h:99
#5 0x00007f8a1efdbd1c in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#6 0x000000000108dd55 in ?? ()
#7 0x00007f8a18519780 in ?? ()
#8 0x0000000000000000 in ?? ()

Tags: bms vrouter
Revision history for this message
chhandak (chhandak) wrote :

Core copied to

ubuntu-build04:/auto/cores/1642781> pwd
/auto/cores/1642781
ubuntu-build04:/auto/cores/1642781> ls -lrt
total 53184
-rwxrwxrwx 1 chhandak epbg 52273152 Nov 17 16:30 core.contrail-tor-ag.21211.5b7s5.1479340698
-rwxrwxrwx 1 chhandak epbg 876358 Nov 17 16:31 contrail-tor-agent-1.log
-rwxrwxrwx 1 chhandak epbg 1020 Nov 17 16:31 contrail-tor-agent-1-stdout.log
-rwxrwxrwx 1 chhandak epbg 937327 Nov 17 16:31 contrail-tor-agent-2.log
-rwxrwxrwx 1 chhandak epbg 1341 Nov 17 16:31 contrail-tor-agent-2-stdout.log
-rwxrwxrwx 1 chhandak epbg 131673 Nov 17 16:31 contrail-vrouter-agent.log
-rwxrwxrwx 1 chhandak epbg 1224 Nov 17 16:31 contrail-vrouter-agent-stdout.log
ubuntu-build04:/auto/cores/1642781>

information type: Proprietary → Public
Changed in juniperopenstack:
importance: Undecided → Critical
assignee: nobody → Hari Prasad Killi (haripk)
Revision history for this message
Hari Prasad Killi (haripk) wrote :

VRF delete timeout, multicast route is pointing to the VRF. Need to look into why this route is not deleted.

(gdb) p *(DBEntry *) 0x7f89fc0e9af0
$29 = (EvpnRouteEntry) {
  <AgentRoute> = {
    <Route> = {
      <DBEntry> = {
        <DBEntryBase> = {
          _vptr.DBEntryBase = 0x10778b0 <vtable for EvpnRouteEntry+16>,
          chg_list_ = <boost::intrusive_hook> next = 0x0 prev = 0x0,
          tpart_ = 0x7f89f0120890,
          state_ = std::map with 0 elements,
          flags = 0 '\000',
          onremoveq_ = (tbb::atomic) false,
          last_change_at_ = 1479339661208109
        },
        members of DBEntry:
        node_ = <boost::intrusive_hook> parent = 0x7f89f01208f8 left = 0x0 right = 0x0
      },
      members of Route:
      path_ = boost::intrusive::list<Path> with 1 elements = {
        [0] = {
          _vptr.Path = 0x10704f0 <vtable for AgentPath+16>,
          node_ = <boost::intrusive_hook> next = 0x7f89fc0e9b78 prev = 0x7f89fc0e9b78,
          time_stamp_usecs_ = 1479339661208108
        }
      }
    },
    members of AgentRoute:
    vrf_ = 0x7f89f011e6e0,
    is_multicast_ = true,
    dependant_routes_ = {
      list_ = boost::intrusive::list<DependencyRef<AgentRoute, AgentRoute>> with 0 elements
    },
    tunnel_nh_list_ = {
      list_ = boost::intrusive::list<DependencyRef<NextHop, AgentRoute>> with 0 elements
    }
  },
  members of EvpnRouteEntry:
  mac_ = ff:ff:ff:ff:ff:ff,
  ip_addr_ = <IPv4 33.33.33.33 >,
  ethernet_tag_ = 13749239,
  publish_to_inet_route_table_ = true,
  publish_to_bridge_route_table_ = true
}

Changed in juniperopenstack:
assignee: Hari Prasad Killi (haripk) → Manish Singh (manishs)
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.2

Review in progress for https://review.opencontrail.org/26989
Submitter: Manish Singh (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/26989
Committed: http://github.org/Juniper/contrail-controller/commit/3f71961dc57a705a389b45d82c1f805fcc9750ba
Submitter: Zuul (<email address hidden>)
Branch: R3.2

commit 3f71961dc57a705a389b45d82c1f805fcc9750ba
Author: Manish <email address hidden>
Date: Thu Dec 8 06:19:16 2016 +0530

Vrf Deletetimeout

During addition of new tor IP for multicast, audit for changed vxlan id in VN as
well. It may so happen that vxlan id has changed and the withdrawal of tor ip
is done using new vxlan id instead of old resulting in stale path.

Change-Id: I0cb7b0f388d50b1ec92b370898f30bdae6c15827
Closes-bug: #1642781

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/27782
Submitter: Manish Singh (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Review in progress for https://review.opencontrail.org/27783
Submitter: Manish Singh (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1

Review in progress for https://review.opencontrail.org/27784
Submitter: Manish Singh (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/27784
Committed: http://github.org/Juniper/contrail-controller/commit/acc13e48264f52b5e6ee30e8b3f79466e7c3d54f
Submitter: Zuul (<email address hidden>)
Branch: R3.1

commit acc13e48264f52b5e6ee30e8b3f79466e7c3d54f
Author: Manish <email address hidden>
Date: Thu Dec 8 06:19:16 2016 +0530

Vrf Deletetimeout

During addition of new tor IP for multicast, audit for changed vxlan id in VN as
well. It may so happen that vxlan id has changed and the withdrawal of tor ip
is done using new vxlan id instead of old resulting in stale path.

Change-Id: I0cb7b0f388d50b1ec92b370898f30bdae6c15827
Closes-bug: #1642781
(cherry picked from commit 3f71961dc57a705a389b45d82c1f805fcc9750ba)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/27783
Committed: http://github.org/Juniper/contrail-controller/commit/9faf54e7aa6caeebfd7be9ce7ee12f86afa34d92
Submitter: Zuul (<email address hidden>)
Branch: master

commit 9faf54e7aa6caeebfd7be9ce7ee12f86afa34d92
Author: Manish <email address hidden>
Date: Thu Dec 8 06:19:16 2016 +0530

Vrf Deletetimeout

During addition of new tor IP for multicast, audit for changed vxlan id in VN as
well. It may so happen that vxlan id has changed and the withdrawal of tor ip
is done using new vxlan id instead of old resulting in stale path.

Closes-bug: #1642781
(cherry picked from commit 3f71961dc57a705a389b45d82c1f805fcc9750ba)

Change-Id: Ie7b433e13cd00762b55fbe3cd9a5f38597720faf

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.0

Review in progress for https://review.opencontrail.org/28946
Submitter: Hari Prasad Killi (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/28946
Committed: http://github.org/Juniper/contrail-controller/commit/b8f85c9446e54237e4870ebda9b34a26f9bee275
Submitter: Zuul (<email address hidden>)
Branch: R3.0

commit b8f85c9446e54237e4870ebda9b34a26f9bee275
Author: Manish <email address hidden>
Date: Thu Dec 8 06:19:16 2016 +0530

Vrf Deletetimeout

During addition of new tor IP for multicast, audit for changed vxlan id in VN as
well. It may so happen that vxlan id has changed and the withdrawal of tor ip
is done using new vxlan id instead of old resulting in stale path.

Change-Id: I0cb7b0f388d50b1ec92b370898f30bdae6c15827
Closes-bug: #1642781
(cherry picked from commit 3f71961dc57a705a389b45d82c1f805fcc9750ba)
(cherry picked from commit acc13e48264f52b5e6ee30e8b3f79466e7c3d54f)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.