[SPARK-3937] Unsafe memory access inside of Snappy library

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.2.0, 1.3.0
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Patrick Wendell
• Created: 13/Oct/14 23:44
• Updated: 06/Jan/17 19:30
• Resolved: 06/Jan/17 19:29

Description

This was observed on master between Spark 1.1 and 1.2. Unfortunately I don't have much information about this other than the stack trace. However, it was concerning enough I figured I should post it.

java.lang.InternalError: a fault occurred in a recent unsafe memory access operation in compiled Java code
        org.xerial.snappy.SnappyNative.rawUncompress(Native Method)
        org.xerial.snappy.Snappy.rawUncompress(Snappy.java:444)
        org.xerial.snappy.Snappy.uncompress(Snappy.java:480)
        org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:355)
        org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159)
        org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142)
        java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310)
        java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream.java:2712)
        java.io.ObjectInputStream$BlockDataInputStream.readFully(ObjectInputStream.java:2742)
        java.io.ObjectInputStream.readArray(ObjectInputStream.java:1687)
        java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1344)
        java.io.ObjectInputStream.readArray(ObjectInputStream.java:1706)
        java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1344)
        java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
        java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
        java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
        org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:62)
        org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:133)
        org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
        scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350)
        org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
        scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:371)
        scala.collection.Iterator$$anon$14.hasNext(Iterator.scala:388)
        scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
        scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:308)
        scala.collection.Iterator$class.foreach(Iterator.scala:727)
        scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
        scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:48)
        scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:103)
        scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:47)
        scala.collection.TraversableOnce$class.to(TraversableOnce.scala:273)
        scala.collection.AbstractIterator.to(Iterator.scala:1157)
        scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:265)
        scala.collection.AbstractIterator.toBuffer(Iterator.scala:1157)
        scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:252)
        scala.collection.AbstractIterator.toArray(Iterator.scala:1157)
        org.apache.spark.sql.execution.Limit$$anonfun$4.apply(basicOperators.scala:140)
        org.apache.spark.sql.execution.Limit$$anonfun$4.apply(basicOperators.scala:140)
        org.apache.spark.SparkContext$$anonfun$runJob$3.apply(SparkContext.scala:1118)
        org.apache.spark.SparkContext$$anonfun$runJob$3.apply(SparkContext.scala:1118)
        org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
        org.apache.spark.scheduler.Task.run(Task.scala:56)
        org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:182)
        java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        java.lang.Thread.run(Thread.java:745)

Issue Links

• is related to: SPARK-16652 JVM crash from unsafe memory access for Dataset of class with List[Long]