Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
Impala 4.1.0
-
ghx-label-8
Description
Backend test scratch-tuple-batch-test failed in my recent ASAN builds ran on impala-private-parameterized. It also happened in recent cdw-master-staging ASAN build: https://master-03.jenkins.cloudera.com/job/impala-cdw-master-staging-core-asan/47/ and asf-master core asan build https://master-03.jenkins.cloudera.com/job/impala-asf-master-core-asan/94/
This new backend test was added by recent commits https://gerrit.cloudera.org/#/c/17860/.
Here is the console output:
21:11:01 ==19341==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x603000390d74 at pc 0x000001d18abf bp 0x7ffd7f9fef30 sp 0x7ffd7f9fef28
21:11:01 READ of size 4 at 0x603000390d74 thread T0
21:11:01 #0 0x1d18abe in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody() /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:159:13
21:11:01 #1 0x5ea0299 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::)(), char const) (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5ea0299)
21:11:01 #2 0x5e99079 in testing::Test::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e99079)
21:11:01 #3 0x5e9915b in testing::TestInfo::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9915b)
21:11:01 #4 0x5e99294 in testing::TestCase::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e99294)
21:11:01 #5 0x5e9993f in testing::internal::UnitTestImpl::RunAllTests() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e9993f)
21:11:01 #6 0x5e99a76 in testing::UnitTest::Run() (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5e99a76)
21:11:01 #7 0x1d18cab in main /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:187:10
21:11:01 #8 0x7feb3bf0bc04 in __libc_start_main (/lib64/libc.so.6+0x21c04)
21:11:01 #9 0x1c20796 in _start (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x1c20796)
21:11:01
21:11:01 0x603000390d74 is located 0 bytes to the right of 20-byte region [0x603000390d60,0x603000390d74)
21:11:01 allocated by thread T0 here:
21:11:01 #0 0x1d135b0 in operator new(unsigned long) /mnt/source/llvm/llvm-5.0.1.src-p3/projects/compiler-rt/lib/asan/asan_new_delete.cc:92
21:11:01 #1 0x1d26ecf in void std::vector<int, std::allocator<int> >::_M_range_initialize<int const*>(int const*, int const*, std::forward_iterator_tag) /data/jenkins/workspace/impala-asf-master-core-asan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/stl_vector.h:1328:35
21:11:01 #2 0x1d1ac6f in std::vector<int, std::allocator<int> >::vector(std::initializer_list<int>, std::allocator<int> const&) /data/jenkins/workspace/impala-asf-master-core-asan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/stl_vector.h:387:2
21:11:01 #3 0x1d18767 in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody() /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:156:22
21:11:01 #4 0x5ea0299 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::)(), char const) (/data0/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/build/debug/exec/scratch-tuple-batch-test+0x5ea0299)
21:11:01
21:11:01 SUMMARY: AddressSanitizer: heap-buffer-overflow /data/jenkins/workspace/impala-asf-master-core-asan/repos/Impala/be/src/exec/scratch-tuple-batch-test.cc:159:13 in ScratchTupleBatchTest_TestRandomGeneratedMicroBatches_Test::TestBody()
21:11:01 Shadow bytes around the buggy address:
21:11:01 0x0c068006a150: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
21:11:01 0x0c068006a160: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
21:11:01 0x0c068006a170: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
21:11:01 0x0c068006a180: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
21:11:01 0x0c068006a190: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
21:11:01 =>0x0c068006a1a0: fa fa fa fa fa fa 00 00 04 fa fa fa 00 00[04]fa
21:11:01 0x0c068006a1b0: fa fa 00 00 00 fa fa fa 00 00 00 fa fa fa 00 00
21:11:01 0x0c068006a1c0: 00 fa fa fa 00 00 00 fa fa fa fd fd fd fd fa fa
21:11:01 0x0c068006a1d0: fd fd fd fa fa fa fd fd fd fa fa fa fd fd fd fa
21:11:01 0x0c068006a1e0: fa fa fd fd fd fa fa fa fd fd fd fa fa fa 00 00
21:11:01 0x0c068006a1f0: 00 fa fa fa fd fd fd fa fa fa fd fd fd fa fa fa
21:11:01 Shadow byte legend (one shadow byte represents 8 application bytes):
21:11:01 Addressable: 00
21:11:01 Partially addressable: 01 02 03 04 05 06 07
21:11:01 Heap left redzone: fa
21:11:01 Freed heap region: fd
21:11:01 Stack left redzone: f1
21:11:01 Stack mid redzone: f2
21:11:01 Stack right redzone: f3
21:11:01 Stack after return: f5
21:11:01 Stack use after scope: f8
21:11:01 Global redzone: f9
21:11:01 Global init order: f6
21:11:01 Poisoned by user: f7
21:11:01 Container overflow: fc
21:11:01 Array cookie: ac
21:11:01 Intra object redzone: bb
21:11:01 ASan internal: fe
21:11:01 Left alloca redzone: ca
21:11:01 Right alloca redzone: cb
21:11:01 ==19341==ABORTING
Attachments
Issue Links
- is broken by
-
IMPALA-9873 Skip decoding of non-materialised columns in Parquet
-
- Resolved
-