Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11985 Improve Solaris support in Hadoop
  3. HADOOP-12630

Misuse of sun.misc.Unsafe by org.apache.hadoop.io.FastByteComparisons causes misaligned memory access coredumps

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.6.0, 2.7.0, 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: native
    • Labels:
      None
    • Environment:

      Solaris SPARC

    • Target Version/s:

      Description

      Misuse of sun.misc.unsafe by org.apache.hadoop.io.FastByteComparisons causes misaligned memory accesses and results in coredumps. Stack traces below:

      hadoop-tools/hadoop-gridmix/core
       --- called from signal handler with signal 10 (SIGBUS) ---
       ffffffff7717fa40 Unsafe_GetLong (18c000, ffffffff7e2fd6d8, 0, 19, ffffffff775d4be0, 10018c000) + 158
       ffffffff70810dcc * sun/misc/Unsafe.getLong(Ljava/lang/Object;J)J+-30004
       ffffffff70810d70 * sun/misc/Unsafe.getLong(Ljava/lang/Object;J)J+0
       ffffffff70806d58 * org/apache/hadoop/io/FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo([BII[BII)I+91 (line 405)
       ffffffff70806cb4 * org/apache/hadoop/io/FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer.compareTo(Ljava/lang/Object;IILjava/lang/Object;II)I+16 (line 264)
       ffffffff7080783c * org/apache/hadoop/io/FastByteComparisons.compareTo([BII[BII)I+11 (line 92)
       ffffffff70806cb4 * org/apache/hadoop/io/WritableComparator.compareBytes([BII[BII)I+8 (line 376)
       ffffffff70806cb4 * org/apache/hadoop/mapred/gridmix/GridmixRecord$Comparator.compare([BII[BII)I+61 (line 522)
       ffffffff70806cb4 * org/apache/hadoop/mapred/gridmix/TestGridmixRecord.binSortTest(Lorg/apache/hadoop/mapred/gridmix/GridmixRecord;Lorg/apache/hadoop/mapred/gridmix/GridmixRecord;IILorg/apache/hadoop/io/WritableComparator;)V+280 (line 268)
       ffffffff70806f44 * org/apache/hadoop/mapred/gridmix/TestGridmixRecord.testBaseRecord()V+57 (line 482)
      

      This also causes hadoop-mapreduce-project/hadoop-mapreduce-examples/core

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                alanburlison Alan Burlison
                Reporter:
                alanburlison Alan Burlison
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated: