Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Cannot Reproduce
-
M4.5
-
None
-
None
Description
create-table-stress-test failed in http://sandbox.jenkins.cloudera.com/job/kudu-test/10866/BUILD_TYPE=ASAN,label=centos6-kudu/
ASAN output:
I0702 09:51:35.509845 9890 tablet_service.cc:280] Processing DeleteTablet for tablet 5648c1eca766474a9b9a23cbf7ce8c69 (Report from unknown tablet) from {real_user=jenkins, eff_user=} at 127.0.0.1:57820
I0702 09:51:35.509951 9890 maintenance_manager.cc:167] Unregistered op FlushRowSetsOp(5648c1eca766474a9b9a23cbf7ce8c69)
I0702 09:51:35.509963 9881 tablet_service.cc:280] Processing DeleteTablet for tablet fec53feed7904f4a9c87c3af87611059 (Report from unknown tablet) from {real_user=jenkins, eff_user=} at 127.0.0.1:57820
I0702 09:51:35.509995 9890 maintenance_manager.cc:167] Unregistered op CompactRowSetsOp(5648c1eca766474a9b9a23cbf7ce8c69)
I0702 09:51:35.509987 9893 tablet_service.cc:280] Processing DeleteTablet for tablet 533154dbd3084ba4aaf51541e7ef4ac7 (Report from unknown tablet) from {real_user=jenkins, eff_user=} at 127.0.0.1:57820
I0702 09:51:35.510025 9890 maintenance_manager.cc:167] Unregistered op FlushDeltaMemStoresOp(5648c1eca766474a9b9a23cbf7ce8c69)
I0702 09:51:35.510072 9893 maintenance_manager.cc:167] Unregistered op FlushRowSetsOp(533154dbd3084ba4aaf51541e7ef4ac7)
I0702 09:51:35.510102 9893 maintenance_manager.cc:167] Unregistered op CompactRowSetsOp(533154dbd3084ba4aaf51541e7ef4ac7)
I0702 09:51:35.510093 9885 tablet_service.cc:280] Processing DeleteTablet for tablet a2bc997271c74348af6351a30322df50 (Report from unknown tablet) from {real_user=jenkins, eff_user=} at 127.0.0.1:57820
I0702 09:51:35.510128 9893 maintenance_manager.cc:167] Unregistered op FlushDeltaMemStoresOp(533154dbd3084ba4aaf51541e7ef4ac7)
I0702 09:51:35.510169 9880 tablet_service.cc:280] Processing DeleteTablet for tablet 2f5c57b449254d648eeb62eb1f74de05 (Report from unknown tablet) from {real_user=jenkins, eff_user=} at 127.0.0.1:57820
I0702 09:51:35.510231 9885 maintenance_manager.cc:167] Unregistered op FlushRowSetsOp(a2bc997271c74348af6351a30322df50)
I0702 09:51:35.510267 9885 maintenance_manager.cc:167] Unregistered op CompactRowSetsOp(a2bc997271c74348af6351a30322df50)
I0702 09:51:35.510298 9885 maintenance_manager.cc:167] Unregistered op FlushDeltaMemStoresOp(a2bc997271c74348af6351a30322df50)
I0702 09:51:35.510299 9879 tablet_service.cc:280] Processing DeleteTablet for tablet 2f33665085e34390a4731792654c939a (Report from unknown tablet) from {real_user=jenkins, eff_user=} at 127.0.0.1:57820
I0702 09:51:35.510352 9881 maintenance_manager.cc:167] Unregistered op FlushRowSetsOp(fec53feed7904f4a9c87c3af87611059)
I0702 09:51:35.510361 9889 tablet_service.cc:280] Processing DeleteTablet for tablet 11ae47b99c424a09b1ebfb661f8e510d (Report from unknown tablet) from {real_user=jenkins, eff_user=} at 127.0.0.1:57820
I0702 09:51:35.510364 9887 tablet_service.cc:280] Processing DeleteTablet for tablet 0c980714585f426dba4b09b5927b972a (Report from unknown tablet) from {real_user=jenkins, eff_user=} at 127.0.0.1:57820
I0702 09:51:35.510395 9879 maintenance_manager.cc:167] Unregistered op FlushRowSetsOp(2f33665085e34390a4731792654c939a)
I0702 09:51:35.510432 9889 maintenance_manager.cc:167] Unregistered op FlushRowSetsOp(11ae47b99c424a09b1ebfb661f8e510d)
I0702 09:51:35.510460 9889 maintenance_manager.cc:167] Unregistered op CompactRowSetsOp(11ae47b99c424a09b1ebfb661f8e510d)
I0702 09:51:35.510484 9889 maintenance_manager.cc:167] Unregistered op FlushDeltaMemStoresOp(11ae47b99c424a09b1ebfb661f8e510d)
I0702 09:51:35.510527 9879 maintenance_manager.cc:167] Unregistered op CompactRowSetsOp(2f33665085e34390a4731792654c939a)
I0702 09:51:35.510579 9881 maintenance_manager.cc:167] Unregistered op CompactRowSetsOp(fec53feed7904f4a9c87c3af87611059)
I0702 09:51:35.510612 9881 maintenance_manager.cc:167] Unregistered op FlushDeltaMemStoresOp(fec53feed7904f4a9c87c3af87611059)
I0702 09:51:35.510648 9887 maintenance_manager.cc:167] Unregistered op FlushRowSetsOp(0c980714585f426dba4b09b5927b972a)
I0702 09:51:35.510697 9887 maintenance_manager.cc:167] Unregistered op CompactRowSetsOp(0c980714585f426dba4b09b5927b972a)
I0702 09:51:35.510758 9887 maintenance_manager.cc:167] Unregistered op FlushDeltaMemStoresOp(0c980714585f426dba4b09b5927b972a)
I0702 09:51:35.510834 9880 maintenance_manager.cc:167] Unregistered op FlushRowSetsOp(2f5c57b449254d648eeb62eb1f74de05)
I0702 09:51:35.510877 9880 maintenance_manager.cc:167] Unregistered op CompactRowSetsOp(2f5c57b449254d648eeb62eb1f74de05)
I0702 09:51:35.510920 9880 maintenance_manager.cc:167] Unregistered op FlushDeltaMemStoresOp(2f5c57b449254d648eeb62eb1f74de05)
I0702 09:51:35.510970 9879 maintenance_manager.cc:167] Unregistered op FlushDeltaMemStoresOp(2f33665085e34390a4731792654c939a)
==6277==ERROR: AddressSanitizer: heap-use-after-free on address 0x61b00005dca8 at pc 0xada927 bp 0x7fb43dafda50 sp 0x7fb43dafda48
READ of size 8 at 0x61b00005dca8 thread T910 (rpc worker-1043)
#0 0xada926 in std::tr1::_Hashtable<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> >, std::allocator<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::_Select1st<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::equal_to<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::hash<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::__detail::_Mod_range_hashing, std::tr1::__detail::_Default_ranged_hash, std::tr1::__detail::_Prime_rehash_policy, false, false, true>::find(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) const /usr/lib/gcc/x86_64-redhat-linux/4.4.6/../../../../include/c++/4.4.6/tr1_impl/hashtable:803
#1 0xabebea in bool FindCopy<std::tr1::unordered_map<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, scoped_refptr<kudu::master::TabletInfo>, std::tr1::hash<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::equal_to<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > > >, std::basic_string<char, std::char_traits<char>, std::allocator<char> >, scoped_refptr<kudu::master::TabletInfo> >(std::tr1::unordered_map<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, scoped_refptr<kudu::master::TabletInfo>, std::tr1::hash<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::equal_to<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > > > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, scoped_refptr<kudu::master::TabletInfo>*) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/gutil/map-util.h:244
#2 0xaa92f0 in kudu::master::CatalogManager::HandleReportedTablet(kudu::master::TSDescriptor*, kudu::master::ReportedTabletPB const&, kudu::master::ReportedTabletUpdatesPB*) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/catalog_manager.cc:972
#3 0xaa86ba in kudu::master::CatalogManager::ProcessTabletReport(kudu::master::TSDescriptor*, kudu::master::TabletReportPB const&, kudu::master::TabletReportUpdatesPB*, kudu::rpc::RpcContext*) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/catalog_manager.cc:946
#4 0xb90216 in kudu::master::MasterServiceImpl::TSHeartbeat(kudu::master::TSHeartbeatRequestPB const*, kudu::master::TSHeartbeatResponsePB*, kudu::rpc::RpcContext*) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/master_service.cc:82
#5 0x10b3cb0 in kudu::rpc::ServicePool::RunThread() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/rpc/service_pool.cc:156
#6 0x10b8f72 in boost::_bi::bind_t<void, boost::_mfi::mf0<void, kudu::rpc::ServicePool>, boost::_bi::list1<boost::_bi::value<kudu::rpc::ServicePool*> > >::operator()() /usr/include/boost/bind/bind_template.hpp:20
#7 0xc8ad0f in boost::function0<void>::operator()() const /usr/include/boost/function/function_template.hpp:1012
#8 0x1271b95 in kudu::Thread::SuperviseThread(boost::function<void ()()>, long*) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/util/thread.cc:463
#9 0x127687a in boost::_mfi::mf2<void, kudu::Thread, boost::function<void ()()>, long*>::operator()(kudu::Thread*, boost::function<void ()()>, long*) const /usr/include/boost/bind/mem_fn_template.hpp:274
#10 0x1276606 in void boost::_bi::list3<boost::_bi::value<kudu::Thread*>, boost::_bi::value<boost::function<void ()()> >, boost::_bi::value<long*> >::operator()<boost::_mfi::mf2<void, kudu::Thread, boost::function<void ()()>, long*>, boost::_bi::list0>(boost::_bi::type<void>, boost::_mfi::mf2<void, kudu::Thread, boost::function<void ()()>, long*>&, boost::_bi::list0&, int) /usr/include/boost/bind/bind.hpp:385
#11 0x1276452 in boost::_bi::bind_t<void, boost::_mfi::mf2<void, kudu::Thread, boost::function<void ()()>, long*>, boost::_bi::list3<boost::_bi::value<kudu::Thread*>, boost::_bi::value<boost::function<void ()()> >, boost::_bi::value<long*> > >::operator()() /usr/include/boost/bind/bind_template.hpp:20
#12 0x1317184 in thread_proxy ??:0
#13 0x9c11c3 in __asan::AsanThread::ThreadStart(unsigned long) ??:0
#14 0x335ca077f0 in ?? ??:0
#15 0x335c6e5ccc in ?? ??:0
0x61b00005dca8 is located 552 bytes inside of 1600-byte region [0x61b00005da80,0x61b00005e0c0)
freed by thread T0 here:
#0 0x9bb1c4 in operator delete(void*) ??:0
#1 0xae4cf2 in std::tr1::_Hashtable<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> >, std::allocator<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::_Select1st<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::equal_to<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::hash<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::__detail::_Mod_range_hashing, std::tr1::__detail::_Default_ranged_hash, std::tr1::__detail::_Prime_rehash_policy, false, false, true>::_M_deallocate_buckets(std::tr1::__detail::_Hash_node<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> >, false>**, unsigned long) /usr/lib/gcc/x86_64-redhat-linux/4.4.6/../../../../include/c++/4.4.6/tr1_impl/hashtable:567
#2 0xaebd7d in std::tr1::_Hashtable<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> >, std::allocator<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::_Select1st<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::equal_to<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::hash<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::__detail::_Mod_range_hashing, std::tr1::__detail::_Default_ranged_hash, std::tr1::__detail::_Prime_rehash_policy, false, false, true>::~_Hashtable() /usr/lib/gcc/x86_64-redhat-linux/4.4.6/../../../../include/c++/4.4.6/tr1_impl/hashtable:725
#3 0xa9989b in kudu::master::CatalogManager::~CatalogManager() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/catalog_manager.cc:298
#4 0xb8f2a6 in base::DefaultDeleter<kudu::master::CatalogManager>::operator()(kudu::master::CatalogManager*) const /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/gutil/gscoped_ptr.h:145
#5 0xb8d97f in kudu::master::Master::~Master() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/master.cc:38
#6 0xb8d906 in kudu::master::Master::~Master() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/master.cc:37
#7 0xb01570 in kudu::master::MiniMaster::StartOnPorts(unsigned short, unsigned short) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/mini_master.cc:60
#8 0xb01b78 in kudu::master::MiniMaster::Restart() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/mini_master.cc:69
#9 0x9cbfc1 in kudu::CreateTableStressTest_RestartMasterDuringCreation_Test::TestBody() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/integration-tests/create-table-stress-test.cc:127
#10 0x11d64af in void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) ??:0
#11 0x11d1419 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) ??:0
#12 0x11bcded in testing::Test::Run() ??:0
#13 0x11bd627 in testing::TestInfo::Run() ??:0
#14 0x11bdc5b in testing::TestCase::Run() ??:0
#15 0x11c2fe8 in testing::internal::UnitTestImpl::RunAllTests() ??:0
#16 0x11d763d in bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) ??:0
#17 0x11d2259 in bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) ??:0
#18 0x11c1b70 in testing::UnitTest::Run() ??:0
#19 0x9ee801 in main /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/util/test_main.cc:36
#20 0x335c61ecdc in ?? ??:0
previously allocated by thread T0 here:
#0 0x9bb004 in operator new(unsigned long) ??:0
#1 0xae49fe in std::tr1::_Hashtable<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> >, std::allocator<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::_Select1st<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::equal_to<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::hash<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::__detail::_Mod_range_hashing, std::tr1::__detail::_Default_ranged_hash, std::tr1::__detail::_Prime_rehash_policy, false, false, true>::_M_allocate_buckets(unsigned long) /usr/lib/gcc/x86_64-redhat-linux/4.4.6/../../../../include/c++/4.4.6/tr1_impl/hashtable:551
#2 0xae44f8 in std::tr1::_Hashtable<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> >, std::allocator<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::_Select1st<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::equal_to<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::hash<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::__detail::_Mod_range_hashing, std::tr1::__detail::_Default_ranged_hash, std::tr1::__detail::_Prime_rehash_policy, false, false, true>::_M_rehash(unsigned long) /usr/lib/gcc/x86_64-redhat-linux/4.4.6/../../../../include/c++/4.4.6/tr1_impl/hashtable:1236
#3 0xae3fc7 in std::tr1::_Hashtable<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> >, std::allocator<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::_Select1st<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::equal_to<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::hash<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::__detail::_Mod_range_hashing, std::tr1::__detail::_Default_ranged_hash, std::tr1::__detail::_Prime_rehash_policy, false, false, true>::_M_insert_bucket(std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > const&, unsigned long, unsigned long) /usr/lib/gcc/x86_64-redhat-linux/4.4.6/../../../../include/c++/4.4.6/tr1_impl/hashtable:950
#4 0xac1408 in std::tr1::__detail::_Map_base<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> >, std::_Select1st<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, true, std::tr1::_Hashtable<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> >, std::allocator<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::_Select1st<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, scoped_refptr<kudu::master::TabletInfo> > >, std::equal_to<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::hash<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::tr1::__detail::_Mod_range_hashing, std::tr1::__detail::_Default_ranged_hash, std::tr1::__detail::_Prime_rehash_policy, false, false, true> >::operator[](std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) /usr/lib/gcc/x86_64-redhat-linux/4.4.6/../../../../include/c++/4.4.6/tr1_impl/hashtable_policy.h:574
#5 0xafe8e6 in kudu::master::TabletLoader::VisitTablet(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, kudu::master::SysTabletsEntryPB const&) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/catalog_manager.cc:140
#6 0xb062a2 in kudu::master::SysTabletsTable::VisitTabletFromRow(kudu::RowBlockRow const&, kudu::master::SysTabletsTable::Visitor*) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/sys_tables.cc:226
#7 0xb05b58 in kudu::master::SysTabletsTable::VisitTablets(kudu::master::SysTabletsTable::Visitor*) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/sys_tables.cc:208
#8 0xa9a552 in kudu::master::CatalogManager::Init(bool) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/catalog_manager.cc:317
#9 0xb8df6d in kudu::master::Master::Init() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/master.cc:54
#10 0xb014c4 in kudu::master::MiniMaster::StartOnPorts(unsigned short, unsigned short) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/mini_master.cc:54
#11 0xb01b78 in kudu::master::MiniMaster::Restart() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/mini_master.cc:69
#12 0x9cbfc1 in kudu::CreateTableStressTest_RestartMasterDuringCreation_Test::TestBody() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/integration-tests/create-table-stress-test.cc:127
#13 0x11d64af in void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) ??:0
#14 0x11d1419 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) ??:0
#15 0x11bcded in testing::Test::Run() ??:0
#16 0x11bd627 in testing::TestInfo::Run() ??:0
#17 0x11bdc5b in testing::TestCase::Run() ??:0
#18 0x11c2fe8 in testing::internal::UnitTestImpl::RunAllTests() ??:0
#19 0x11d763d in bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) ??:0
#20 0x11d2259 in bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) ??:0
#21 0x11c1b70 in testing::UnitTest::Run() ??:0
#22 0x9ee801 in main /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/util/test_main.cc:36
#23 0x335c61ecdc in ?? ??:0
Thread T910 (rpc worker-1043) created by T0 here:
#0 0x9b6b90 in __interceptor_pthread_create ??:0
#1 0x1316cd4 in boost::thread::start_thread() ??:0
#2 0x1271215 in kudu::Thread::StartThread(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, boost::function<void ()()> const&, scoped_refptr<kudu::Thread>*) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/util/thread.cc:403
#3 0x10b5add in kudu::Status kudu::Thread::Create<void (kudu::rpc::ServicePool::*)(), kudu::rpc::ServicePool*>(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, void (kudu::rpc::ServicePool::* const&)(), kudu::rpc::ServicePool* const&, scoped_refptr<kudu::Thread>*) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/util/thread.h:123
#4 0x10b3678 in kudu::rpc::ServicePool::Init(int) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/rpc/service_pool.cc:59
#5 0xba1b6a in kudu::RpcServer::Start(gscoped_ptr<kudu::rpc::ServiceIf, base::DefaultDeleter<kudu::rpc::ServiceIf> >) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/server/rpc_server.cc:81
#6 0xbab2d8 in kudu::server::ServerBase::Start(gscoped_ptr<kudu::rpc::ServiceIf, base::DefaultDeleter<kudu::rpc::ServiceIf> >) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/server/server_base.cc:167
#7 0xb8e390 in kudu::master::Master::Start() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/master.cc:64
#8 0xb01503 in kudu::master::MiniMaster::StartOnPorts(unsigned short, unsigned short) /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/mini_master.cc:55
#9 0xb01b78 in kudu::master::MiniMaster::Restart() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/master/mini_master.cc:69
#10 0x9cbfc1 in kudu::CreateTableStressTest_RestartMasterDuringCreation_Test::TestBody() /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/integration-tests/create-table-stress-test.cc:127
#11 0x11d64af in void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) ??:0
#12 0x11d1419 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) ??:0
#13 0x11bcded in testing::Test::Run() ??:0
#14 0x11bd627 in testing::TestInfo::Run() ??:0
#15 0x11bdc5b in testing::TestCase::Run() ??:0
#16 0x11c2fe8 in testing::internal::UnitTestImpl::RunAllTests() ??:0
#17 0x11d763d in bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) ??:0
#18 0x11d2259 in bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) ??:0
#19 0x11c1b70 in testing::UnitTest::Run() ??:0
#20 0x9ee801 in main /var/lib/jenkins/workspace/kudu-test/BUILD_TYPE/ASAN/label/centos6-kudu/src/util/test_main.cc:36
#21 0x335c61ecdc in ?? ??:0
Shadow bytes around the buggy address:
0x0c3680003b40: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
0x0c3680003b50: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
0x0c3680003b60: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
0x0c3680003b70: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
0x0c3680003b80: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
=>0x0c3680003b90: fd fd fd fd fd[fd]fd fd fd fd fd fd fd fd fd fd
0x0c3680003ba0: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
0x0c3680003bb0: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
0x0c3680003bc0: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
0x0c3680003bd0: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
0x0c3680003be0: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
Shadow byte legend (one shadow byte represents 8 application bytes):
Addressable: 00
Partially addressable: 01 02 03 04 05 06 07
Heap left redzone: fa
Heap right redzone: fb
Freed heap region: fd
Stack left redzone: f1
Stack mid redzone: f2
Stack right redzone: f3
Stack partial redzone: f4
Stack after return: f5
Stack use after scope: f8
Global redzone: f9
Global init order: f6
Poisoned by user: f7
ASan internal: fe
==6277==ABORTING