Juniper Openstack

[R2.0-Build 8]: agent core seen at FlowEntry::GetLocalFlowSgList

Bug #1398885 reported by alok kumar
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Fix Committed
Critical
Manish Singh
R2.0
Fix Committed
Critical
Manish Singh
Juniper Openstack r2.0-fcs

Bug Description

root@nodeh8:~# gdb /usr/bin/contrail-vrouter-agent /var/crashes/core.contrail-vroute.1667.nodeh8.1417622053
GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1
Copyright (C) 2014 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/bin/contrail-vrouter-agent...(no debugging symbols found)...done.

warning: core file may not match specified executable file.
[New LWP 2545]
[New LWP 2546]
[New LWP 7609]
[New LWP 2547]
[New LWP 1667]
[New LWP 2544]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/bin/contrail-vrouter-agent'.
Program terminated with signal SIGABRT, Aborted.
#0 0x00007fda573b5bb9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
56 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory.
(gdb) bt
#0 0x00007fda573b5bb9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1 0x00007fda573b8fc8 in __GI_abort () at abort.c:89
#2 0x00007fda573aea76 in __assert_fail_base (fmt=0x7fda57500370 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0xe728fa "px != 0",
    file=file@entry=0xe81b78 "/usr/include/boost/smart_ptr/intrusive_ptr.hpp", line=line@entry=162,
    function=function@entry=0xebc5c0 "T* boost::intrusive_ptr<T>::operator->() const [with T = SgEntry]") at assert.c:92
#3 0x00007fda573aeb22 in __GI___assert_fail (assertion=0xe728fa "px != 0", file=0xe81b78 "/usr/include/boost/smart_ptr/intrusive_ptr.hpp", line=162,
    function=0xebc5c0 "T* boost::intrusive_ptr<T>::operator->() const [with T = SgEntry]") at assert.c:101
#4 0x00000000009f518d in ?? ()
#5 0x00000000009fc29a in ?? ()
#6 0x00000000009fc2fc in FlowEntry::GetLocalFlowSgList(VmInterface const*, VmInterface const*) ()
#7 0x00000000009fc49a in FlowEntry::GetPolicyInfo(VnEntry const*) ()
#8 0x0000000000a02bb2 in FlowTable::ResyncVmPortFlows(VmInterface const*) ()
#9 0x0000000000d86792 in DBTableBase::RunNotify(DBTablePartBase*, DBEntryBase*) ()
#10 0x0000000000d87c18 in DBTablePartBase::RunNotify() ()
#11 0x0000000000d85bf1 in DBPartition::QueueRunner::Run() ()
#12 0x0000000000e680c0 in TaskImpl::execute() ()
#13 0x00007fda57f85b3a in ?? () from /usr/lib/libtbb.so.2
#14 0x00007fda57f81816 in ?? () from /usr/lib/libtbb.so.2
#15 0x00007fda57f80f4b in ?? () from /usr/lib/libtbb.so.2
#16 0x00007fda57f7d0ff in ?? () from /usr/lib/libtbb.so.2
#17 0x00007fda57f7d2f9 in ?? () from /usr/lib/libtbb.so.2
#18 0x00007fda581a1182 in start_thread (arg=0x7fda50002700) at pthread_create.c:312
#19 0x00007fda57479fbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

setup info:
env.roledefs = {
    'all': [host1,host2,host3,host4,host5],
    'cfgm': [host1,host2,host5],
    'openstack':[host2],
    'control': [host2,host1],
    'compute': [host3,host4],
    'collector': [host2,host1],
    'webui': [host1],
    'database': [host1,host2,host5],
    'build': [host_build],
}

env.hostnames = {
    'all': ['nodec64', 'nodeg18', 'nodeh8', 'nodec11', 'nodec12']
}

core seen after running test case scripts/securitygroup/test_regression.py: test_sg_stateful

all logs @mayamruga:/home/bhushana/Documents/technical/bugs/<bugId>

Tags: vrouter
Nagabhushana R (bhushana)
Changed in juniperopenstack:
milestone: r2.0-fcs → none
tags: added: blocker
Revision history for this message
Ashish Ranjan (aranjan-n) wrote :
Download full text (4.7 KiB)

Assigning to Praveen.

Looking at the code sg_ can be NULL if SecurityGroupEntry::Activate() is not called.
So, deref at CopySgEntries() @flow_table.cc:565 needs to have null check.

uuid is also NULL. that may to be investigated. Per Ajay id_perms 'may' come in separate message.

-----

(gdb) bt
#0 0x00007fda573b5bb9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1 0x00007fda573b8fc8 in __GI_abort () at abort.c:89
#2 0x00007fda573aea76 in __assert_fail_base (fmt=0x7fda57500370 "/LC_MESSAGES/%N:", assertion=assertion@entry=0xe728fa "px != 0",
    file=file@entry=0xe81b78 "/usr/include/boost/smart_ptr/intrusive_ptr.hpp", line=line@entry=162,
    function=function@entry=0xebc5c0 <boost::intrusive_ptr<SgEntry>::operator->() const::__PRETTY_FUNCTION__> "T* boost::intrusive_ptr<T>::operator->() const [with T = SgEntry]") at assert.c:92
#3 0x00007fda573aeb22 in __GI___assert_fail (assertion=0xe728fa "px != 0", file=0xe81b78 "/usr/include/boost/smart_ptr/intrusive_ptr.hpp",
    line=162,
    function=0xebc5c0 <boost::intrusive_ptr<SgEntry>::operator->() const::__PRETTY_FUNCTION__> "T* boost::intrusive_ptr<T>::operator->() const [with T = SgEntry]") at assert.c:101
#4 0x00000000009f518d in boost::intrusive_ptr<SgEntry>::operator-> (this=<optimized out>) at /usr/include/boost/smart_ptr/intrusive_ptr.hpp:162
#5 0x00000000009fc29a in operator-> (this=<optimized out>) at controller/src/vnsw/agent/pkt/flow_table.cc:582
#6 CopySgEntries (vm_port=vm_port@entry=0x7fda440cd910, list=..., ingress_acl=true) at controller/src/vnsw/agent/pkt/flow_table.cc:565
#7 0x00000000009fc2fc in FlowEntry::GetLocalFlowSgList (this=this@entry=0x7fda38013640, vm_port=0x7fda440cd910, reverse_vm_port=0x0)
    at controller/src/vnsw/agent/pkt/flow_table.cc:588
#8 0x00000000009fc43f in FlowEntry::GetSgList (this=this@entry=0x7fda38013640, intf=<optimized out>)
    at controller/src/vnsw/agent/pkt/flow_table.cc:680
#9 0x00000000009fc49a in FlowEntry::GetPolicyInfo (this=0x7fda38013640, vn=0x7fda48023460) at controller/src/vnsw/agent/pkt/flow_table.cc:889
#10 0x0000000000a02bb2 in FlowTable::ResyncVmPortFlows (this=0x7fda44018b90, intf=0x7fda440cd910)
    at controller/src/vnsw/agent/pkt/flow_table.cc:2171
#11 0x0000000000d86792 in operator() (a1=0x7fda440cd920, a0=0x7fda4400f4a0, this=0x7fda50001b10)
    at /usr/include/boost/function/function_template.hpp:767
#12 RunNotify (entry=0x7fda440cd920, tpart=0x7fda4400f4a0, this=0x7fda4400f420) at controller/src/db/db_table.cc:88
#13 DBTableBase::RunNotify (this=<optimized out>, tpart=tpart@entry=0x7fda4400f4a0, entry=entry@entry=0x7fda440cd920)
    at controller/src/db/db_table.cc:132
#14 0x0000000000d87c18 in DBTablePartBase::RunNotify (this=this@entry=0x7fda4400f4a0) at controller/src/db/db_table_partition.cc:45
#15 0x0000000000d85bf1 in DBPartition::QueueRunner::Run (this=0x7fda48072480) at controller/src/db/db_partition.cc:178
#16 0x0000000000e680c0 in TaskImpl::execute (this=0x7fda505dbb40) at controller/src/base/task.cc:224
#17 0x00007fda57f85b3a in tbb::internal::custom_scheduler<tbb::internal::IntelSchedulerTraits>::local_wait_for_all (this=0x7fda505d7e00,
    parent=..., child=<optimi...

Read more...

Changed in juniperopenstack:
assignee: nobody → Manish Singh (manishs)
information type: Proprietary → Public
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/5594
Committed: http://github.org/Juniper/contrail-controller/commit/7b923f8d1b2bdac75ce3b3c9826f9805bec39ff4
Submitter: Zuul
Branch: R2.0

commit 7b923f8d1b2bdac75ce3b3c9826f9805bec39ff4
Author: Ananth Suryanarayana <email address hidden>
Date: Fri Dec 12 14:45:05 2014 -0800

Commit on behalf of Manish
Add null check as sg_ can be NULL if SecurityGroupEntry::Activate() is
not called.

Change-Id: Ic40815d36425ee4524cfd06d2a99ae04e6caa0f6
Closes-bug: 1398885

Hari Prasad Killi (haripk)
tags: removed: blocker
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/5892
Committed: http://github.org/Juniper/contrail-controller/commit/b64fe29ddc96c0e969af8788bccaba2f1956d032
Submitter: Zuul
Branch: master

commit b64fe29ddc96c0e969af8788bccaba2f1956d032
Author: manishsingh <email address hidden>
Date: Wed Dec 10 14:18:26 2014 +0530

Add null check as sg_ can be NULL if SecurityGroupEntry::Activate() is
not called.

recheck no bug

Change-Id: Icd030ded7fc0e03fe7326478a0476d90619a58a3
Closes-bug: 1398885

Changed in juniperopenstack:
status: New → Fix Committed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.