[IMPALA-5245] buffer-allocator-test failed in ASAN build

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.9.0
• Fix Version/s: Impala 2.9.0
• Component/s: Backend
• Target Version: Impala 2.9.0
• Epic Color: ghx-label-7
• Assignee: Tim Armstrong
• Reporter: Michael Ho
• Created: 22/Apr/17 00:09
• Updated: 09/May/17 16:40
• Resolved: 09/May/17 16:40

Description

Looks like certain large allocation in sub may have caused ASAN to allocate a huge amount of memory and failed. tarmstrong, can you please take a first look and reassign if necessary ?

00:00:30 [ RUN      ] SystemAllocatorTest.LargeAllocFailure
00:00:30 ==26508==WARNING: AddressSanitizer failed to allocate 0x1000000000000 bytes
00:00:30 ==26508==AddressSanitizer's allocator is terminating the process instead of returning 0
00:00:30 ==26508==If you don't like this behavior set allocator_may_return_null=1
00:00:30 ==26508==AddressSanitizer CHECK failed: /data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-centos-6/toolchain/source/llvm/llvm-3.8.0.src-p1/projects/compiler-rt/lib/sanitizer_common/sanitizer_allocator.cc:147 "((0)) != (0)" (0x0, 0x0)
00:00:30     #0 0x102115d in __asan::AsanCheckFailed(char const*, int, char const*, unsigned long long, unsigned long long) /data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-centos-6/toolchain/source/llvm/llvm-3.8.0.src-p1/projects/compiler-rt/lib/asan/asan_rtl.cc:67
00:00:30     #1 0x1027c93 in __sanitizer::CheckFailed(char const*, int, char const*, unsigned long long, unsigned long long) /data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-centos-6/toolchain/source/llvm/llvm-3.8.0.src-p1/projects/compiler-rt/lib/sanitizer_common/sanitizer_common.cc:159
00:00:30     #2 0x10259e6 in __sanitizer::ReportAllocatorCannotReturnNull() /data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-centos-6/toolchain/source/llvm/llvm-3.8.0.src-p1/projects/compiler-rt/lib/sanitizer_common/sanitizer_allocator.cc:147
00:00:30     #3 0xf7aae6 in __sanitizer::CombinedAllocator<__sanitizer::SizeClassAllocator64<105553116266496ul, 4398046511104ul, 0ul, __sanitizer::SizeClassMap<17ul, 128ul, 16ul>, __asan::AsanMapUnmapCallback>, __sanitizer::SizeClassAllocatorLocalCache<__sanitizer::SizeClassAllocator64<105553116266496ul, 4398046511104ul, 0ul, __sanitizer::SizeClassMap<17ul, 128ul, 16ul>, __asan::AsanMapUnmapCallback> >, __sanitizer::LargeMmapAllocator<__asan::AsanMapUnmapCallback> >::ReturnNullOrDie() /data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-centos-6/toolchain/source/llvm/llvm-3.8.0.src-p1/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_allocator.h:1317
00:00:30     #4 0xf7aae6 in __asan::Allocator::Allocate(unsigned long, unsigned long, __sanitizer::BufferedStackTrace*, __asan::AllocType, bool) /data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-centos-6/toolchain/source/llvm/llvm-3.8.0.src-p1/projects/compiler-rt/lib/asan/asan_allocator.cc:359
00:00:30     #5 0x1017821 in __interceptor_malloc /data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-centos-6/toolchain/source/llvm/llvm-3.8.0.src-p1/projects/compiler-rt/lib/asan/asan_malloc_linux.cc:53
00:00:30     #6 0x107e81f in impala::SystemAllocator::Allocate(long, impala::BufferPool::BufferHandle*) /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/src/runtime/bufferpool/system-allocator.cc:56:45
00:00:30     #7 0x104daae in impala::SystemAllocatorTest_LargeAllocFailure_Test::TestBody() /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/src/runtime/bufferpool/buffer-allocator-test.cc:173:19
00:00:30     #8 0x2c0d552 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/build/debug/runtime/bufferpool/buffer-allocator-test+0x2c0d552)
00:00:30     #9 0x2c040c9 in testing::Test::Run() (/data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/build/debug/runtime/bufferpool/buffer-allocator-test+0x2c040c9)
00:00:30     #10 0x2c04217 in testing::TestInfo::Run() (/data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/build/debug/runtime/bufferpool/buffer-allocator-test+0x2c04217)
00:00:30     #11 0x2c042f4 in testing::TestCase::Run() (/data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/build/debug/runtime/bufferpool/buffer-allocator-test+0x2c042f4)
00:00:30     #12 0x2c05577 in testing::internal::UnitTestImpl::RunAllTests() (/data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/build/debug/runtime/bufferpool/buffer-allocator-test+0x2c05577)
00:00:30     #13 0x2c05852 in testing::UnitTest::Run() (/data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/build/debug/runtime/bufferpool/buffer-allocator-test+0x2c05852)
00:00:30     #14 0x104e18f in main /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/src/runtime/bufferpool/buffer-allocator-test.cc:192:12
00:00:30     #15 0x3be821ecdc in __libc_start_main (/lib64/libc.so.6+0x3be821ecdc)
00:00:30     #16 0xf71c54 in _start (/data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/be/build/debug/runtime/bufferpool/buffer-allocator-test+0xf71c54)
00:00:30 
00:00:30