Details
-
Bug
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
Impala 3.0, Impala 2.12.0
-
ghx-label-8
Description
ASAN fails with memcpy-param-overlap in {{impala::RawValue::Write during RowBatchSerializeTest.RowBatchLZ4Success:
joemcdonnell - I’m assigning this to you thinking you might have an idea what’s going on here; feel free to find another person or assign back to me if you're swamped.
I’ve seen this happen in a private Jenkins run. Please ping me if you would like access to the build artifacts.
I saw this in builds that also had issues during the e2e tests, so I'm not sure whether this is flaky or reproducibly broken.
=================================================================
==25468==ERROR: AddressSanitizer: memcpy-param-overlap: memory ranges [0x7fab21b68800,0x7fab4bb687ef) and [0x7fab21b67818, 0x7fab4bb67807) overlap
#0 0x13a2011 in __asan_memcpy /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent64-ec2-c3-4xl-ondem/toolchain/source/llvm/llvm-3.9.1.src/projects/compiler-rt/lib/asan/asan_interceptors.cc:413
#1 0x152d0bd in impala::RawValue::Write(void const*, void*, impala::ColumnType const&, impala::MemPool*) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/raw-value.cc:145:47
#2 0x13fe797 in impala::RowBatchSerializeTest::TestRowBatchLimits(long) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:145:5
#3 0x13f4396 in impala::RowBatchSerializeTest_RowBatchLZ4Success_Test::TestBody() /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:410:19
#4 0x3f403a2 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f403a2)
#5 0x3f37cf9 in testing::Test::Run() (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f37cf9)
#6 0x3f37e47 in testing::TestInfo::Run() (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f37e47)
#7 0x3f37f24 in testing::TestCase::Run() (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f37f24)
#8 0x3f391a7 in testing::internal::UnitTestImpl::RunAllTests() (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f391a7)
#9 0x3f39482 in testing::UnitTest::Run() (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f39482)
#10 0x13fab3e in main /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:768:47
#11 0x304581ecdc in __libc_start_main (/lib64/libc.so.6+0x304581ecdc)
#12 0x13016d0 in _start (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x13016d0)
0x7fab21b68800 is located 0 bytes inside of 704643055-byte region [0x7fab21b68800,0x7fab4bb687ef)
allocated by thread T0 here:
#0 0x13b9188 in __interceptor_malloc /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent64-ec2-c3-4xl-ondem/toolchain/source/llvm/llvm-3.9.1.src/projects/compiler-rt/lib/asan/asan_malloc_linux.cc:64
#1 0x151888f in impala::MemPool::FindChunk(long, bool) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.cc:148:45
#2 0x14011e9 in unsigned char* impala::MemPool::Allocate<false>(long, int) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.h:270:30
#3 0x14011e9 in impala::MemPool::Allocate(long) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.h:101
#4 0x152cf42 in impala::RawValue::Write(void const*, void*, impala::ColumnType const&, impala::MemPool*) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/raw-value.cc:158:51
#5 0x13fe797 in impala::RowBatchSerializeTest::TestRowBatchLimits(long) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:145:5
#6 0x13f4396 in impala::RowBatchSerializeTest_RowBatchLZ4Success_Test::TestBody() /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:410:19
#7 0x3f403a2 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f403a2)
0x7fab21b67818 is located 4072 bytes to the left of 704643055-byte region [0x7fab21b68800,0x7fab4bb687ef)
allocated by thread T0 here:
#0 0x13b9188 in __interceptor_malloc /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent64-ec2-c3-4xl-ondem/toolchain/source/llvm/llvm-3.9.1.src/projects/compiler-rt/lib/asan/asan_malloc_linux.cc:64
#1 0x151888f in impala::MemPool::FindChunk(long, bool) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.cc:148:45
#2 0x14011e9 in unsigned char* impala::MemPool::Allocate<false>(long, int) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.h:270:30
#3 0x14011e9 in impala::MemPool::Allocate(long) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.h:101
#4 0x152cf42 in impala::RawValue::Write(void const*, void*, impala::ColumnType const&, impala::MemPool*) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/raw-value.cc:158:51
#5 0x13fe797 in impala::RowBatchSerializeTest::TestRowBatchLimits(long) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:145:5
#6 0x13f4396 in impala::RowBatchSerializeTest_RowBatchLZ4Success_Test::TestBody() /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:410:19
#7 0x3f403a2 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f403a2)
SUMMARY: AddressSanitizer: memcpy-param-overlap /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent64-ec2-c3-4xl-ondem/toolchain/source/llvm/llvm-3.9.1.src/projects/compiler-rt/lib/asan/asan_interceptors.cc:413 in __asan_memcpy
==25468==ABORTING