[IMPALA-5409] Crash on CreateSocket / loadTrustedCertificates

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: Impala 2.9.0
• Component/s: Backend
• Labels: bugbash-2017-05-31
• Epic Color: ghx-label-7
• Assignee: Unassigned
• Reporter: Joe McDonnell
• Created: 31/May/17 22:23
• Updated: 25/Apr/22 17:00
• Resolved: 25/Apr/22 17:00

Description

impalad LOG, minidump, and symbolized minidump attached.

0 libcrypto.so.1.0.1e + 0x12622a
rax = 0x0000000000088b1f rdx = 0x0000000004a55340
rcx = 0x000000000000016a rbx = 0x00007f65182b0bc0
rsi = 0x00000000000000b3 rdi = 0x00007f64c55bb8c0
rbp = 0x00000000000000b3 rsp = 0x00007f5c4d4dc120
r8 = 0x00000031c8f239a0 r9 = 0x0000000000000002
r10 = 0x00007f5c4d4dbff8 r11 = 0x00007f5c4d4dbe90
r12 = 0x00000000000000b3 r13 = 0x00007f60c5285d40
r14 = 0x00007f64c55bb8c0 r15 = 0x00007f5c4d4dc3e0
rip = 0x00000031c8f2622a
Found by: given as instruction pointer in context
1 libcrypto.so.1.0.1e + 0x126340
rsp = 0x00007f5c4d4dc150 rip = 0x00000031c8f26340
Found by: stack scanning
2 libcrypto.so.1.0.1e + 0x11ce8e
rsp = 0x00007f5c4d4dc170 rip = 0x00000031c8f1ce8e
Found by: stack scanning
3 impalad!apache::thrift::transport::TSSLSocketFactory::loadTrustedCertificates(char const*$
rsp = 0x00007f5c4d4dc190 rip = 0x0000000001b3d0d7
Found by: stack scanning
4 impalad!impala::ThriftClientImpl::CreateSocket() + 0x117
rbx = 0x0000000020908520 rbp = 0x00007f5c4d4dc290
rsp = 0x00007f5c4d4dc1f0 r12 = 0x00007f5c4d4dc818
r13 = 0x0000000000000000 rip = 0x0000000000dd4937
Found by: call frame info
5 impalad!impala::ThriftClientImpl::ThriftClientImpl(std::string const&, int, bool) + 0xa0
rbx = 0x0000000020908520 rbp = 0x00000000361baea0
rsp = 0x00007f5c4d4dc280 r12 = 0x00007f5c4d4dc818
r13 = 0x0000000000000000 rip = 0x0000000000a142b0
Found by: call frame info
6 impalad!impala::ThriftClient<impala::ImpalaBackendClient>::ThriftClient(std::string const$
rbx = 0x0000000020908520 rbp = 0x0000000020908520
rsp = 0x00007f5c4d4dc2c0 r12 = 0x00007f5c4d4dc818
r13 = 0x0000000000000000 rip = 0x0000000000a15a73
Found by: call frame info
7 impalad!impala::ClientCache<impala::ImpalaBackendClient>::MakeClient(impala::TNetworkAddr$
rbx = 0x00000000123b86d0 rbp = 0x0000000020908520
rsp = 0x00007f5c4d4dc380 r12 = 0x00007f5c4d4dc818
r13 = 0x00007f5c4d4dc3e0 r14 = 0x0000000000000001
r15 = 0x00007f5c4d4dc3d0 rip = 0x0000000000a161ea
Found by: call frame info
8 impalad!boost::detail::function::function_obj_invoker2<boost::_bi::bind_t<impala::ThriftC$
rbx = 0x00000000361baab0 rbp = 0x0000000013173300
rsp = 0x00007f5c4d4dc3b0 r12 = 0x0000000000a161b0
r13 = 0x0000000000000001 r14 = 0x00007f5c4d4dc3e0
r15 = 0x00007f5c4d4dc3d0 rip = 0x0000000000a13a24
Found by: call frame info
9 impalad!impala::ClientCacheHelper::CreateClient(impala::TNetworkAddress const&, boost::fu$
rbx = 0x00007f64c55bb760 rbp = 0x00007f5c4d4dc818
rsp = 0x00007f5c4d4dc430 r12 = 0x00007f5c4d4dc5e0
r13 = 0x00007f5c4d4dc818 r14 = 0x0000000013173300
r15 = 0x00007f64e8b64480 rip = 0x0000000000a520a4
Found by: call frame info
10 impalad!impala::ClientCacheHelper::ReopenClient(boost::function<impala::ThriftClientImpl*$
rbx = 0x00007f64c55bb760 rbp = 0x00007f5c4d4dc818
rsp = 0x00007f5c4d4dc4b0 r12 = 0x00007f5c4d4dc550
r13 = 0x0000000013173300 r14 = 0x00007f5c4d4dc5e0
r15 = 0x00007f64e8b64480 rip = 0x0000000000a52aab
Found by: call frame info
11 impalad!impala::ClientCache<impala::ImpalaBackendClient>::ReopenClient(impala::ImpalaBack$
rbx = 0x0000000013173300 rbp = 0x00007f5c4d4dc5e0
rsp = 0x00007f5c4d4dc540 r12 = 0x00007f5c4d4dc550
r13 = 0x0000000000000000 r14 = 0x00007f5c4d4dc880
r15 = 0x00007f5c4d4dc840 rip = 0x0000000000a6f078
Found by: call frame info
12 impalad!impala::Status impala::ClientConnection<impala::ImpalaBackendClient>::DoRpc<void $
rbx = 0x00007f5c4d4dc810 rbp = 0x00007f5c4d4dc680
rsp = 0x00007f5c4d4dc590 r12 = 0x00007f5c4d4dc720
r13 = 0x0000000000000000 r14 = 0x00007f5c4d4dc880
r15 = 0x00007f5c4d4dc840 rip = 0x0000000000df7435
Found by: call frame info
13 impalad!impala::DataStreamSender::Channel::DoTransmitDataRpc(impala::ClientConnection<imp$
rbx = 0x00007f5c4d4dc7c0 rbp = 0x00007f5c4d4dc780
rsp = 0x00007f5c4d4dc690 r12 = 0x00007f5c4d4dc840
r13 = 0x000000007edecc00 r14 = 0x00007f5c4d4dc720
r15 = 0x00007f5c4d4dc6f0 rip = 0x0000000000df3c2d
Found by: call frame info