Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9800

BE test parquet-plain-test crashes in ubsan test

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • Impala 4.0.0
    • None

    Description

      Jenkins log:

      18/122 Test  #18: parquet-plain-test ...............***Failed    1.66 sec
Turning perftools heap leak checking off
seed = 1590735754
Note: Google Test filter = PlainEncoding.*
[==========] Running 4 tests from 1 test case.
[----------] Global test environment set-up.
[----------] 4 tests from PlainEncoding
[ RUN      ] PlainEncoding.Basic
[       OK ] PlainEncoding.Basic (1 ms)
[ RUN      ] PlainEncoding.Batch
2020-05-29 00:02:34,975 INFO  util.JvmPauseMonitor (JvmPauseMonitor.java:run(190)) - Starting JVM pause monitor
Wrote minidump to /data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/logs/be_tests/minidumps/unifiedbetests/358b26b7-358a-4528-d1a6bf8d-79773a69.dmp
Wrote minidump to /data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/logs/be_tests/minidumps/unifiedbetests/358b26b7-358a-4528-d1a6bf8d-79773a69.dmp
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x000000000210c403, pid=15155, tid=0x00007fc5dec0e9c0
#
# JRE version: Java(TM) SE Runtime Environment (8.0_144-b01) (build 1.8.0_144-b01)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.144-b01 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C  [unifiedbetests+0x1d0c403]  void impala::DecimalUtil::DecodeFromFixedLenByteArray<impala::DecimalValue<__int128> >(unsigned char const*, int, impala::DecimalValue<__int128>*)+0x1a3
#
# Core dump written. Default location: /data0/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/be/src/exec/parquet/core or core.15155
#
# An error report file with more information is saved as:
# /data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/logs/hs_err_pid15155.log
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
/data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/be/build/debug//exec/parquet/parquet-plain-test: line 10: 15155 Aborted                 (core dumped) ${IMPALA_HOME}/bin/run-jvm-binary.sh ${IMPALA_HOME}/be/build/latest/service/unifiedbetests --gtest_filter=${GTEST_FILTER} --gtest_output=xml:${IMPALA_BE_TEST_LOGS_DIR}/${TEST_EXEC_NAME}.xml -log_filename="${TEST_EXEC_NAME}" "$@"
Traceback (most recent call last):
  File "/data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/bin/junitxml_prune_notrun.py", line 71, in <module>
    if __name__ == "__main__": main()
  File "/data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/bin/junitxml_prune_notrun.py", line 68, in main
    junitxml_prune_notrun(options.filename)
  File "/data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/bin/junitxml_prune_notrun.py", line 31, in junitxml_prune_notrun
    root = tree.parse(junitxml_filename)
  File "/usr/lib64/python2.7/xml/etree/ElementTree.py", line 647, in parse
    source = open(source, "rb")
IOError: [Errno 2] No such file or directory: '/data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/logs/be_tests/parquet-plain-test.xml'

      Error Message

      Minidump generated: /data/jenkins/workspace/impala-asf-master-core-ubsan/repos/Impala/logs/be_tests/minidumps/unifiedbetests/358b26b7-358a-4528-d1a6bf8d-79773a69.dmp

      Standard Error

      Operating system: Linux
                  0.0.0 Linux 3.10.0-693.5.2.el7.x86_64 #1 SMP Fri Oct 20 20:32:50 UTC 2017 x86_64
CPU: amd64
     family 6 model 85 stepping 4
     1 CPU

GPU: UNKNOWN

Crash reason:  SIGSEGV
Crash address: 0x0
Process uptime: not available

Thread 0 (crashed)
 0  unifiedbetests!void impala::DecimalUtil::DecodeFromFixedLenByteArray<impala::DecimalValue<__int128> >(unsigned char const*, int, impala::DecimalValue<__int128>*) [decimal-util.h : 132 + 0x12]
    rax = 0x000000001983c014   rdx = 0x0000000000000010
    rcx = 0x00007ffe49b8bb01   rbx = 0x00000000020bc580
    rsi = 0x00007ffe49b8bc60   rdi = 0x00007ffe49b8bc6c
    rbp = 0x00007ffe49b8bcd0   rsp = 0x00007ffe49b8bb70
     r8 = 0x000000001983c001    r9 = 0x00000000000000ff
    r10 = 0x0000000000000001   r11 = 0x0000000000000000
    r12 = 0x0000000015f2a2a0   r13 = 0x00000000092bb17f
    r14 = 0x000001725f3d56e0   r15 = 0x0000000008f6a160
    rip = 0x000000000210c403
    Found by: given as instruction pointer in context
 1  unifiedbetests!int impala::DecodeDecimalByteArray<impala::DecimalValue<__int128> >(unsigned char const*, unsigned char const*, int, impala::DecimalValue<__int128>*) [parquet-common.h : 653 + 0x5]
    rbx = 0x00000000020bc580   rbp = 0x00007ffe49b8bd50
    rsp = 0x00007ffe49b8bce0   r12 = 0x0000000015f2a2a0
    r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
    r15 = 0x0000000008f6a160   rip = 0x000000000210c242
    Found by: call frame info
 2  unifiedbetests!int impala::ParquetPlainEncoder::Decode<impala::DecimalValue<__int128>, (parquet::Type::type)6>(unsigned char const*, unsigned char const*, int, impala::DecimalValue<__int128>*) [parquet-common.h : 675 + 0x5]
    rbx = 0x00000000020bc580   rbp = 0x00007ffe49b8bd80
    rsp = 0x00007ffe49b8bd60   r12 = 0x0000000015f2a2a0
    r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
    r15 = 0x0000000008f6a160   rip = 0x000000000210bb1b
    Found by: call frame info
 3  unifiedbetests!void impala::TestTypeWideningBatch<impala::DecimalValue<__int128>, impala::DecimalValue<__int128>, (parquet::Type::type)6>(std::vector<impala::DecimalValue<__int128>, std::allocator<impala::DecimalValue<__int128> > > const&, int, int) [parquet-plain-test.cc : 319 + 0x13]
    rbx = 0x00000000020bc580   rbp = 0x00007ffe49b8c080
    rsp = 0x00007ffe49b8bd90   r12 = 0x0000000015f2a2a0
    r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
    r15 = 0x0000000008f6a160   rip = 0x000000000212df83
    Found by: call frame info
 4  unifiedbetests!void impala::TestTypeBatch<impala::DecimalValue<__int128>, (parquet::Type::type)6>(std::vector<impala::DecimalValue<__int128>, std::allocator<impala::DecimalValue<__int128> > > const&, int, int) [parquet-plain-test.cc : 349 + 0x9]
    rbx = 0x00000000020bc580   rbp = 0x00007ffe49b8c0b0
    rsp = 0x00007ffe49b8c090   r12 = 0x0000000015f2a2a0
    r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
    r15 = 0x0000000008f6a160   rip = 0x00000000020c4fa6
    Found by: call frame info
 5  unifiedbetests!impala::PlainEncoding_Batch_Test::TestBody() [parquet-plain-test.cc : 436 + 0xe]
    rbx = 0x00000000020bc580   rbp = 0x00007ffe49b8d6f0
    rsp = 0x00007ffe49b8c0c0   r12 = 0x0000000015f2a2a0
    r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
    r15 = 0x0000000008f6a160   rip = 0x00000000020bcbfb
    Found by: call frame info
 6  unifiedbetests!void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) + 0x33
    rbx = 0x00000000020bc580   rbp = 0x0000000000000000
    rsp = 0x00007ffe49b8d700   r12 = 0x0000000015f2a2a0
    r13 = 0x00000000092bb17f   r14 = 0x000001725f3d56e0
    r15 = 0x0000000008f6a160   rip = 0x0000000008f85173
    Found by: call frame info
 7  unifiedbetests!testing::Test::Run() + 0xba
    rbx = 0x0000000015f2a2a0   rbp = 0x0000000008f6a160
    rsp = 0x00007ffe49b8d740   r12 = 0x00000000111c0000
    r13 = 0x0000000015f2a2a0   r14 = 0x000001725f3d56e0
    r15 = 0x0000000008f6a160   rip = 0x0000000008f7cdca
    Found by: call frame info
 8  unifiedbetests!testing::TestInfo::Run() + 0x118
    rbx = 0x00000000111ae840   rbp = 0x00000000111c0000
    rsp = 0x00007ffe49b8d760   r12 = 0x00000000111c4780
    r13 = 0x0000000015f2a2a0   r14 = 0x000001725f3d56e0
    r15 = 0x0000000008f6a160   rip = 0x0000000008f7cf18
    Found by: call frame info
 9  unifiedbetests!testing::TestCase::Run() + 0xb5
    rbx = 0x0000000000000002   rbp = 0x00000000111bf720
    rsp = 0x00007ffe49b8d7a0   r12 = 0x00000000111c0000
    r13 = 0x00000000111c4780   r14 = 0x0000000008f6a160
    r15 = 0x000001725f3d56df   rip = 0x0000000008f7cff5
    Found by: call frame info
10  unifiedbetests!testing::internal::UnitTestImpl::RunAllTests() + 0x258
    rbx = 0x00000000111c0000   rbp = 0x00000000111c4780
    rsp = 0x00007ffe49b8d7f0   r12 = 0x0000000000000018
    r13 = 0x0000000000000000   r14 = 0x000001725f3d56df
    r15 = 0x000000001055e2d4   rip = 0x0000000008f7e278
    Found by: call frame info
11  unifiedbetests!testing::UnitTest::Run() + 0x33
    rbx = 0x00000000111c0000   rbp = 0x00007ffe49b8d960
    rsp = 0x00007ffe49b8d880   r12 = 0x0000000001ca3dce
    r13 = 0x00007ffe49b8da40   r14 = 0x0000000000000000
    r15 = 0x0000000000000000   rip = 0x0000000008f7e553
    Found by: call frame info
12  unifiedbetests!main [unified-betest-main.cc : 48 + 0x1b]
    rbx = 0x0000000000000000   rbp = 0x00007ffe49b8d960
    rsp = 0x00007ffe49b8d8a0   r12 = 0x0000000001ca3dce
    r13 = 0x00007ffe49b8da40   r14 = 0x0000000000000000
    r15 = 0x0000000000000000   rip = 0x0000000001cc9386
    Found by: call frame info
13  libc-2.17.so + 0x21c05
    rbx = 0x0000000000000000   rbp = 0x0000000000000000
    rsp = 0x00007ffe49b8d970   r12 = 0x0000000001ca3dce
    r13 = 0x00007ffe49b8da40   r14 = 0x0000000000000000

       

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-9801 E2E tests crashed in DecimalUtil::DecodeFromFixedLenByteArray

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-9801 E2E tests crashed in DecimalUtil::DecodeFromFixedLenByteArray

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              joemcdonnell Joe McDonnell
              stigahuang Quanlong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: