Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6601

ASAN memcpy-param-overlap in impala::RawValue::Write during RowBatchSerializeTest.RowBatchLZ4Success

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: Impala 3.0, Impala 2.12.0
    • Fix Version/s: Impala 2.12.0
    • Component/s: Backend
    • Labels:

      Description

      ASAN fails with memcpy-param-overlap in {{impala::RawValue::Write during RowBatchSerializeTest.RowBatchLZ4Success:

      Joe McDonnell - I’m assigning this to you thinking you might have an idea what’s going on here; feel free to find another person or assign back to me if you're swamped.

      I’ve seen this happen in a private Jenkins run. Please ping me if you would like access to the build artifacts.

      I saw this in builds that also had issues during the e2e tests, so I'm not sure whether this is flaky or reproducibly broken.

      =================================================================
      ==25468==ERROR: AddressSanitizer: memcpy-param-overlap: memory ranges [0x7fab21b68800,0x7fab4bb687ef) and [0x7fab21b67818, 0x7fab4bb67807) overlap
          #0 0x13a2011 in __asan_memcpy /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent64-ec2-c3-4xl-ondem/toolchain/source/llvm/llvm-3.9.1.src/projects/compiler-rt/lib/asan/asan_interceptors.cc:413
          #1 0x152d0bd in impala::RawValue::Write(void const*, void*, impala::ColumnType const&, impala::MemPool*) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/raw-value.cc:145:47
          #2 0x13fe797 in impala::RowBatchSerializeTest::TestRowBatchLimits(long) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:145:5
          #3 0x13f4396 in impala::RowBatchSerializeTest_RowBatchLZ4Success_Test::TestBody() /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:410:19
          #4 0x3f403a2 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f403a2)
          #5 0x3f37cf9 in testing::Test::Run() (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f37cf9)
          #6 0x3f37e47 in testing::TestInfo::Run() (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f37e47)
          #7 0x3f37f24 in testing::TestCase::Run() (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f37f24)
          #8 0x3f391a7 in testing::internal::UnitTestImpl::RunAllTests() (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f391a7)
          #9 0x3f39482 in testing::UnitTest::Run() (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f39482)
          #10 0x13fab3e in main /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:768:47
          #11 0x304581ecdc in __libc_start_main (/lib64/libc.so.6+0x304581ecdc)
          #12 0x13016d0 in _start (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x13016d0)
      
      0x7fab21b68800 is located 0 bytes inside of 704643055-byte region [0x7fab21b68800,0x7fab4bb687ef)
      allocated by thread T0 here:
          #0 0x13b9188 in __interceptor_malloc /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent64-ec2-c3-4xl-ondem/toolchain/source/llvm/llvm-3.9.1.src/projects/compiler-rt/lib/asan/asan_malloc_linux.cc:64
          #1 0x151888f in impala::MemPool::FindChunk(long, bool) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.cc:148:45
          #2 0x14011e9 in unsigned char* impala::MemPool::Allocate<false>(long, int) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.h:270:30
          #3 0x14011e9 in impala::MemPool::Allocate(long) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.h:101
          #4 0x152cf42 in impala::RawValue::Write(void const*, void*, impala::ColumnType const&, impala::MemPool*) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/raw-value.cc:158:51
          #5 0x13fe797 in impala::RowBatchSerializeTest::TestRowBatchLimits(long) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:145:5
          #6 0x13f4396 in impala::RowBatchSerializeTest_RowBatchLZ4Success_Test::TestBody() /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:410:19
          #7 0x3f403a2 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f403a2)
      
      0x7fab21b67818 is located 4072 bytes to the left of 704643055-byte region [0x7fab21b68800,0x7fab4bb687ef)
      allocated by thread T0 here:
          #0 0x13b9188 in __interceptor_malloc /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent64-ec2-c3-4xl-ondem/toolchain/source/llvm/llvm-3.9.1.src/projects/compiler-rt/lib/asan/asan_malloc_linux.cc:64
          #1 0x151888f in impala::MemPool::FindChunk(long, bool) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.cc:148:45
          #2 0x14011e9 in unsigned char* impala::MemPool::Allocate<false>(long, int) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.h:270:30
          #3 0x14011e9 in impala::MemPool::Allocate(long) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/mem-pool.h:101
          #4 0x152cf42 in impala::RawValue::Write(void const*, void*, impala::ColumnType const&, impala::MemPool*) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/raw-value.cc:158:51
          #5 0x13fe797 in impala::RowBatchSerializeTest::TestRowBatchLimits(long) /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:145:5
          #6 0x13f4396 in impala::RowBatchSerializeTest_RowBatchLZ4Success_Test::TestBody() /data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/src/runtime/row-batch-serialize-test.cc:410:19
          #7 0x3f403a2 in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) (/data/jenkins/workspace/impala-asf-2.x-core-asan/repos/Impala/be/build/debug/runtime/row-batch-serialize-test+0x3f403a2)
      
      SUMMARY: AddressSanitizer: memcpy-param-overlap /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent64-ec2-c3-4xl-ondem/toolchain/source/llvm/llvm-3.9.1.src/projects/compiler-rt/lib/asan/asan_interceptors.cc:413 in __asan_memcpy
      ==25468==ABORTING
      

        Attachments

          Activity

            People

            • Assignee:
              joemcdonnell Joe McDonnell
              Reporter:
              lv Lars Volker
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: