[MAPREDUCE-6346] mapred.nativetask.kvtest.KVTest crashes on PPC64LE

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 3.0.0-alpha1

Environment

RHEL 7.1 - PPC64 LE - OpenJDK rhel-2.5.5.1.ael7b_1-ppc64le u79-b14

• Assignee: Ayappan
• Reporter: Tony Reix
• Created: 29/Apr/15 13:17
• Updated: 16/May/17 15:42
• Resolved: 16/May/17 15:42

Description

Test org.apache.hadoop.mapred.nativetask.kvtest.KVTest (and 5 or 6 other tests) crashes on PPC64LE .

....
15/04/28 10:46:06 INFO Mid-spill:

{ id: 4, collect: 245 ms, in-memory sort: 32 ms, in-memory records: 48202, merge&spill: 80 ms, uncompressed size: 5031451, real size: 3739319 path: /tmp/hadoop-reixt/mapred/local/localRunner/reixt/jobcache/job_local408221154_0008/attempt_local408221154_0008_m_000000_0/output/spill4.out }

1. A fatal error has been detected by the Java Runtime Environment:
   #
2. SIGSEGV (0xb) at pc=0x00003fff6c7d8e50, pid=945, tid=70366264881616
   #
3. JRE version: OpenJDK Runtime Environment (7.0_79-b14) (build 1.7.0_79-mockbuild_2015_04_10_10_48-b00)
4. Java VM: OpenJDK 64-Bit Server VM (24.79-b02 mixed mode linux-ppc64 compressed oops)
5. Derivative: IcedTea 2.5.5
6. Distribution: Built on Red Hat Enterprise Linux Server release 7.1 (Maipo) (Fri Apr 10 10:48:01 EDT 2015)
7. Problematic frame:
8. C [libnativetask.so.1.0.0+0x58e50] NativeTask::WritableUtils::ReadVLongInner(char const*, unsigned int&)+0x40
   #
9. Core dump written. Default location: /home/reixt/HADOOP-2.7.0/hadoop-FromApache-Trunk-201504241115/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/core or core.945
   #
10. An error report file with more information is saved as:
11. /tmp/jvm-945/hs_error.log
    #
12. If you would like to submit a bug report, please include
13. instructions on how to reproduce the bug and visit:
14. http://icedtea.classpath.org/bugzilla
15. The crash happened outside the Java Virtual Machine in native code.
16. See problematic frame for where to report the bug.
    #
    /bin/sh: line 1: 945 Aborted (core dumped) /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.79-2.5.5.1.ael7b_1.ppc64le/jre/bin/java -Xmx4096m -XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar /home/reixt/HADOOP-2.7.0/hadoop-FromApache-Trunk-201504241115/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/target/surefire/surefirebooter9078773752877532263.jar /home/reixt/HADOOP-2.7.0/hadoop-FromApache-Trunk-201504241115/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/target/surefire/surefire4138802116387705281tmp /home/reixt/HADOOP-2.7.0/hadoop-FromApache-Trunk-201504241115/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/target/surefire/surefire_01525011254551870798tmp

/tmp/jvm-945/hs_error.log :

1. C [libnativetask.so.1.0.0+0x58e50] NativeTask::WritableUtils::ReadVLongInner(char const*, unsigned int&)+0x40

Issue Links

• duplicates: MAPREDUCE-6459 Native task crashes when merging spilled file on ppc64
• is related to: MAPREDUCE-6459 Native task crashes when merging spilled file on ppc64