[IMPALA-1020] Crash in impala::DictDecoder<impala::DecimalValue<__int128> >::GetValue() on ASAN build.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Bug
• Affects Version/s: Impala 1.3.1
• Fix Version/s: Impala 1.4
• Assignee: Unassigned
• Reporter: Alexander Behm
• Created: 25/May/14 07:35
• Updated: 26/May/14 22:56
• Resolved: 26/May/14 22:56

Description

While investigating IMPALA-1010 I ran into a crash that looks different from the original issue:

I managed to get a core using some magic asan flags:

export ASAN_OPTIONS="handle_segv=0:abort_on_error=1:unmap_shadow_on_exit=1:disable_core=0"

I suspect some parts of the core are broken though (look at the file size).

The core file and impalad binary are here:
p0418.mtv.cloudera.com:/srv/jenkins/coredumps/impala-master-asan-parquet-dict-crash

Stack of the crash:

(gdb) bt
#0  0x0000003239a328e5 in raise () from /lib64/libc.so.6
#1  0x0000003239a340c5 in abort () from /lib64/libc.so.6
#2  0x00007f73f9201727 in os::abort(bool) () from /opt/toolchain/sun-jdk-64bit-1.6.0.31/jre/lib/amd64/server/libjvm.so
#3  0x00007f73f9354cc8 in VMError::report_and_die() () from /opt/toolchain/sun-jdk-64bit-1.6.0.31/jre/lib/amd64/server/libjvm.so
#4  0x00007f73f92080e5 in JVM_handle_linux_signal () from /opt/toolchain/sun-jdk-64bit-1.6.0.31/jre/lib/amd64/server/libjvm.so
#5  0x00007f73f92043ee in signalHandler(int, siginfo*, void*) () from /opt/toolchain/sun-jdk-64bit-1.6.0.31/jre/lib/amd64/server/libjvm.so
#6  <signal handler called>
#7  0x00000000014cc42a in impala::DictDecoder<impala::DecimalValue<__int128> >::GetValue (this=<value optimized out>, value=0x6210021e8118)
    at /srv/jenkins/workspace/impala-ishaan-asan/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/util/dict-encoding.h:223
#8  0x00000000014cbfb5 in impala::HdfsParquetScanner::ColumnReader<impala::DecimalValue<__int128> >::ReadSlot (this=0x61200062bfc0, 
    slot=0x6210021e8118, pool=0x20e4840, conjuncts_failed=0x7f6fe6d169a0)
    at /srv/jenkins/workspace/impala-ishaan-asan/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/exec/hdfs-parquet-scanner.cc:298
#9  0x00000000014c8d85 in impala::HdfsParquetScanner::BaseColumnReader::ReadValue (this=0x61200062bfc0, pool=0x6070011fbaf0, 
    tuple=0x6210021e8100, conjuncts_failed=0x7f6fe6d169a0)
    at /srv/jenkins/workspace/impala-ishaan-asan/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/exec/hdfs-parquet-scanner.cc:691
#10 0x00000000014c56a1 in impala::HdfsParquetScanner::AssembleRows (this=0x6130006a5740)
    at /srv/jenkins/workspace/impala-ishaan-asan/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/exec/hdfs-parquet-scanner.cc:744
#11 0x00000000014c2ab0 in impala::HdfsParquetScanner::ProcessSplit (this=0x6130006a5740)
    at /srv/jenkins/workspace/impala-ishaan-asan/BUILD_TYPE/ASAN/label/impala/repos/Impala/be/src/exec/hdfs-parquet-scanner.cc:723
#12 0x00000000014667de in impala::HdfsScanNode::ScannerThread (this=0x61a0006dbc80)
...