[HADOOP-12630] Misuse of sun.misc.Unsafe by org.apache.hadoop.io.FastByteComparisons causes misaligned memory access coredumps

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.6.0, 2.7.0, 3.0.0-alpha1
• Component/s: native

Environment

Solaris SPARC

• Target Version/s: 2.7.8
• Assignee: Alan Burlison
• Reporter: Alan Burlison
• Created: 09/Dec/15 14:45
• Updated: 25/Oct/19 20:25

Description

Misuse of sun.misc.unsafe by org.apache.hadoop.io.FastByteComparisons causes misaligned memory accesses and results in coredumps. Stack traces below:

hadoop-tools/hadoop-gridmix/core
 --- called from signal handler with signal 10 (SIGBUS) ---
 ffffffff7717fa40 Unsafe_GetLong (18c000, ffffffff7e2fd6d8, 0, 19, ffffffff775d4be0, 10018c000) + 158
 ffffffff70810dcc * sun/misc/Unsafe.getLong(Ljava/lang/Object;J)J+-30004
 ffffffff70810d70 * sun/misc/Unsafe.getLong(Ljava/lang/Object;J)J+0
 ffffffff70806d58 * org/apache/hadoop/io/FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo([BII[BII)I+91 (line 405)
 ffffffff70806cb4 * org/apache/hadoop/io/FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo(Ljava/lang/Object;IILjava/lang/Object;II)I+16 (line 264)
 ffffffff7080783c * org/apache/hadoop/io/FastByteComparisons.compareTo([BII[BII)I+11 (line 92)
 ffffffff70806cb4 * org/apache/hadoop/io/WritableComparator.compareBytes([BII[BII)I+8 (line 376)
 ffffffff70806cb4 * org/apache/hadoop/mapred/gridmix/GridmixRecord$Comparator.compare([BII[BII)I+61 (line 522)
 ffffffff70806cb4 * org/apache/hadoop/mapred/gridmix/TestGridmixRecord.binSortTest(Lorg/apache/hadoop/mapred/gridmix/GridmixRecord;Lorg/apache/hadoop/mapred/gridmix/GridmixRecord;IILorg/apache/hadoop/io/WritableComparator;)V+280 (line 268)
 ffffffff70806f44 * org/apache/hadoop/mapred/gridmix/TestGridmixRecord.testBaseRecord()V+57 (line 482)

This also causes hadoop-mapreduce-project/hadoop-mapreduce-examples/core

Issue Links

• relates to: HADOOP-12690 Consolidate access of sun.misc.Unsafe