[HADOOP-12720] Misuse of sun.misc.Unsafe by org.apache.hadoop.io.FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo causes misaligned memory access coredumps

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.7.1
• Component/s: io
• Labels: Solaris

Environment

Solaris SPARC

• Assignee: Alan Burlison
• Reporter: Alan Burlison
• Created: 18/Jan/16 13:46
• Updated: 25/Dec/18 07:24

Description

Core dump details below:

# Java VM: Java HotSpot(TM) 64-Bit Server VM (24.85-b07 mixed mode solaris-sparc compressed oops)
# Problematic frame:
# J 86 C2 org.apache.hadoop.io.FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo([BII[BII)I (273 bytes) @ 0xffffffff6fc9b150 [0xffffffff6fc9b0e0+0x70]

Stack: [0xffffffff7e200000,0xffffffff7e300000],  sp=0xffffffff7e2fce50,  free space=1011k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
J 86 C2 org.apache.hadoop.io.FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo([BII[BII)I (273 bytes) @ 0xffffffff6fc9b150 [0xffffffff6fc9b0e0+0x70]
j  org.apache.hadoop.io.FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo(Ljava/lang/Object;IILjava/lang/Object;II)I+16
j  org.apache.hadoop.io.FastByteComparisons.compareTo([BII[BII)I+11
j  org.apache.hadoop.io.WritableComparator.compareBytes([BII[BII)I+8
j  org.apache.hadoop.io.Text$Comparator.compare([BII[BII)I+39
j  org.apache.hadoop.io.TestText.testCompare()V+167
v  ~StubRoutines::call_stub

# Problematic frame:
# V  [libjvm.so+0xc7fa40]  Unsafe_GetLong+0x158

Stack: [0xffffffff7e200000,0xffffffff7e300000],  sp=0xffffffff7e2fc9b0,  free space=1010k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V  [libjvm.so+0xc7fa40]  Unsafe_GetLong+0x158
j  sun.misc.Unsafe.getLong(Ljava/lang/Object;J)J+-292148
j  sun.misc.Unsafe.getLong(Ljava/lang/Object;J)J+0
j  org.apache.hadoop.io.FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo([BII[BII)I+91
j  org.apache.hadoop.io.FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo(Ljava/lang/Object;IILjava/lang/Object;II)I+16
j  org.apache.hadoop.io.FastByteComparisons.compareTo([BII[BII)I+11
j  org.apache.hadoop.io.WritableComparator.compareBytes([BII[BII)I+8
j  org.apache.hadoop.mapred.gridmix.GridmixRecord$Comparator.compare([BII[BII)I+61
j  org.apache.hadoop.mapred.gridmix.TestGridmixRecord.binSortTest(Lorg/apache/hadoop/mapred/gridmix/GridmixRecord;Lorg/apache/hadoop/mapred/gridmix/GridmixRecord;IILorg/apache/hadoop/io/WritableComparator;)V+280
j  org.apache.hadoop.mapred.gridmix.TestGridmixRecord.testBaseRecord()V+57
v  ~StubRoutines::call_stub

Issue Links

• is broken by: HADOOP-7761 Improve performance of raw comparisons
• relates to: HADOOP-15338 Java 11 runtime support