[KUDU-3072] minidump-test failed on aarch64 server

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.12.0
• Assignee: huangtianhua
• Reporter: huangtianhua
• Created: 10/Mar/20 01:36
• Updated: 14/Apr/20 02:28
• Resolved: 14/Apr/20 02:28

Description

I test kudu on aarch64 server based on https://gerrit.cloudera.org/#/c/14964/ , the test minidump-test failed, error details info see http://paste.openstack.org/show/790470/ :
[==========] Running 8 tests from 2 test cases.
[----------] Global test environment set-up.
[----------] 2 tests from MinidumpDeathTest
[ RUN ] MinidumpDeathTest.TestRegisterAndDelete
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0309 02:17:29.248252 26035 minidump.cc:241] Setting minidump size limit to 20M

[WARNING] /home/jenkins/workspace/kudu/thirdparty/src/googletest-release-1.8.0/googletest/src/gtest-death-test.cc:836:: Death tests use fork(), which is unsafe particularly in a threaded context. For this test, Google Test detected 3 threads.
Wrote minidump to /tmp/kudutest-0/minidump-test.MinidumpDeathTest.TestRegisterAndDelete.1583720249245925-26035/minidumps/minidump-test/884bfadb-15be-463e-ab19968c-be52ffe0.dmp
/home/jenkins/workspace/kudu/src/kudu/util/minidump-test.cc:71: Failure
Death test:

{ abort(); }

Result: died but not with expected error.
Expected: kudu::MinidumpDeathTest_TestRegisterAndDelete_Test::TestBody()
Actual msg:
[ DEATH ] Wrote minidump to /tmp/kudutest-0/minidump-test.MinidumpDeathTest.TestRegisterAndDelete.1583720249245925-26035/minidumps/minidump-test/884bfadb-15be-463e-ab19968c-be52ffe0.dmp
[ DEATH ] *** Aborted at 1583720249 (unix time) try "date -d @1583720249" if you are using GNU date ***
[ DEATH ] PC: @ 0x0 (unknown)
[ DEATH ] *** SIGABRT (@0x65b6) received by PID 26038 (TID 0xffff845d9010) from PID 26038; stack trace: ***
[ DEATH ] @ 0xffff85875688 ([vdso]+0x687)
[ DEATH ] @ 0xffff84cba4d8 raise
[ DEATH ] @ 0xffff84cba464 raise
[ DEATH ]
I0309 02:17:29.562698 26035 test_util.cc:147] -----------------------------------------------
I0309 02:17:29.562726 26035 test_util.cc:148] Had fatal failures, leaving test files at /tmp/kudutest-0/minidump-test.MinidumpDeathTest.TestRegisterAndDelete.1583720249245925-26035
[ FAILED ] MinidumpDeathTest.TestRegisterAndDelete (316 ms)
[ RUN ] MinidumpDeathTest.TestCheckStackTraceAndMinidump
I0309 02:17:29.563597 26035 minidump.cc:241] Setting minidump size limit to 20M

[WARNING] /home/jenkins/workspace/kudu/thirdparty/src/googletest-release-1.8.0/googletest/src/gtest-death-test.cc:836:: Death tests use fork(), which is unsafe particularly in a threaded context. For this test, Google Test detected 3 threads.
Wrote minidump to /tmp/kudutest-0/minidump-test.MinidumpDeathTest.TestCheckStackTraceAndMinidump.1583720249245925-26035/minidumps/minidump-test/578fe2af-ffae-47a9-54c969bb-d909b4b5.dmp
/home/jenkins/workspace/kudu/src/kudu/util/minidump-test.cc:97: Failure
Death test:

{ while (google::_Check_string* _result = google::Check_EQImpl( google::GetReferenceableValue(1), google::GetReferenceableValue(0), "1" " " "==" " " "0")) google::LogMessageFatal("/home/jenkins/workspace/kudu/src/kudu/util/minidump-test.cc", 97, google::CheckOpString(_result)).stream(); }

Result: died but not with expected error.
Expected: kudu::MinidumpDeathTest_TestCheckStackTraceAndMinidump_Test::TestBody()
Actual msg:
[ DEATH ] F0309 02:17:29.564812 26042 minidump-test.cc:97] Check failed: 1 == 0 (1 vs. 0)
[ DEATH ] *** Check failure stack trace: ***
[ DEATH ] Wrote minidump to /tmp/kudutest-0/minidump-test.MinidumpDeathTest.TestCheckStackTraceAndMinidump.1583720249245925-26035/minidumps/minidump-test/578fe2af-ffae-47a9-54c969bb-d909b4b5.dmp
[ DEATH ] *** Aborted at 1583720249 (unix time) try "date -d @1583720249" if you are using GNU date ***
[ DEATH ] PC: @ 0x0 (unknown)
[ DEATH ] *** SIGABRT (@0x65ba) received by PID 26042 (TID 0xffff845d9010) from PID 26042; stack trace: ***
[ DEATH ] @ 0xffff85875688 ([vdso]+0x687)
[ DEATH ] @ 0xffff84cba4d8 raise
[ DEATH ] @ 0xffff84cba464 raise
[ DEATH ]
I0309 02:17:29.752290 26035 test_util.cc:147] -----------------------------------------------
I0309 02:17:29.752316 26035 test_util.cc:148] Had fatal failures, leaving test files at /tmp/kudutest-0/minidump-test.MinidumpDeathTest.TestCheckStackTraceAndMinidump.1583720249245925-26035
[ FAILED ] MinidumpDeathTest.TestCheckStackTraceAndMinidump (190 ms)
[----------] 2 tests from MinidumpDeathTest (506 ms total)
......

I found stack stracing of glog doesn't support on aarch64, so the death assertion is failed, I have proposed a pr to google/glog https://github.com/google/glog/pull/529