Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1097

ConcurrentModificationException

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 1.0.1, 1.0.2, 1.1.0
    • Component/s: Spark Core
    • Labels:
      None

      Description

      14/02/16 08:18:45 WARN TaskSetManager: Loss was due to java.util.ConcurrentModificationException
      java.util.ConcurrentModificationException
      	at java.util.HashMap$HashIterator.nextEntry(HashMap.java:926)
      	at java.util.HashMap$KeyIterator.next(HashMap.java:960)
      	at java.util.AbstractCollection.addAll(AbstractCollection.java:341)
      	at java.util.HashSet.<init>(HashSet.java:117)
      	at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:554)
      	at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:439)
      	at org.apache.spark.rdd.HadoopRDD.getJobConf(HadoopRDD.scala:110)
      	at org.apache.spark.rdd.HadoopRDD$$anon$1.<init>(HadoopRDD.scala:154)
      	at org.apache.spark.rdd.HadoopRDD.compute(HadoopRDD.scala:149)
      	at org.apache.spark.rdd.HadoopRDD.compute(HadoopRDD.scala:64)
      	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:241)
      	at org.apache.spark.rdd.RDD.iterator(RDD.scala:232)
      	at org.apache.spark.rdd.MappedRDD.compute(MappedRDD.scala:31)
      	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:241)
      	at org.apache.spark.rdd.RDD.iterator(RDD.scala:232)
      	at org.apache.spark.rdd.UnionPartition.iterator(UnionRDD.scala:32)
      	at org.apache.spark.rdd.UnionRDD.compute(UnionRDD.scala:72)
      	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:241)
      	at org.apache.spark.rdd.RDD.iterator(RDD.scala:232)
      	at org.apache.spark.rdd.FlatMappedRDD.compute(FlatMappedRDD.scala:33)
      	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:241)
      	at org.apache.spark.rdd.RDD.iterator(RDD.scala:232)
      	at org.apache.spark.rdd.MappedRDD.compute(MappedRDD.scala:31)
      	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:241)
      	at org.apache.spark.rdd.RDD.iterator(RDD.scala:232)
      	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:161)
      	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:102)
      	at org.apache.spark.scheduler.Task.run(Task.scala:53)
      	at org.apache.spark.executor.Executor$TaskRunner$$anonfun$run$1.apply$mcV$sp(Executor.scala:213)
      	at org.apache.spark.deploy.SparkHadoopUtil.runAsUser(SparkHadoopUtil.scala:49)
      	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:178)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:744)
      

        Attachments

        Issue Links

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              colorant Raymond Liu Assign to me
              Reporter:
              Mistobaan Fabrizio Milo

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment