Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-744

BlockManagerUI with no RDD: java.lang.UnsupportedOperationException: empty.reduceLeft

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Trivial
    • Resolution: Incomplete
    • 0.7.0
    • None
    • None
    • None

    Description

      Steps:
      1. Start a Spark app, which starts Spark (I'm using Mesos)
      2. Point browser to the BlockManager web UI before any RDD is created.
      3. Exception!

      2013-05-04 09:15:17,903 [spark-akka.actor.default-dispatcher-9201] ERROR cc.spray.HttpService - Error during processing of request HttpRequest(GET,/,List(Cookie: sessionid="d569ee15ea0b4dfebaa5eeca2465c051"; csrftoken="a81cda0fc43c8de4097268d89096a026"; session="4TujZqbfGWbBeJ8F1W+FIkxLw1E=?csrf=Uyc0NTFmYjI5ZjliMTBmZDlkZTZkZTZhMmUwZGZlZjJlZTZkOTQ5ZjUxJwpwMQou", Accept-Language: en-US, en, Accept-Encoding: gzip, deflate, sdch, user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_6_8) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1490.2 Safari/537.36, Accept: text/html, application/xhtml+xml, application/xml, */*, Connection: keep-alive, Host: localhost:33971),None,HTTP/1.1)
      java.lang.UnsupportedOperationException: empty.reduceLeft
              at scala.collection.TraversableOnce$class.reduceLeft(TraversableOnce.scala:152)
              at scala.collection.mutable.ArrayOps.scala$collection$IndexedSeqOptimized$$super$reduceLeft(ArrayOps.scala:38)
              at scala.collection.IndexedSeqOptimized$class.reduceLeft(IndexedSeqOptimized.scala:69)
              at scala.collection.mutable.ArrayOps.reduceLeft(ArrayOps.scala:38)
              at scala.collection.TraversableOnce$class.reduce(TraversableOnce.scala:180)
              at scala.collection.mutable.ArrayOps.reduce(ArrayOps.scala:38)
              at spark.storage.BlockManagerUI$$anonfun$5.apply(BlockManagerUI.scala:50)
              at spark.storage.BlockManagerUI$$anonfun$5.apply(BlockManagerUI.scala:46)
              at cc.spray.directives.MarshallingDirectives$$anonfun$completeWith$1.apply(MarshallingDirectives.scala:90)
              at cc.spray.directives.MarshallingDirectives$$anonfun$completeWith$1.apply(MarshallingDirectives.scala:90)
              at cc.spray.directives.SprayRoute$$anonfun$fromRouting$1.apply(BasicDirectives.scala:104)
              at cc.spray.directives.SprayRoute$$anonfun$fromRouting$1.apply(BasicDirectives.scala:102)
              at cc.spray.directives.MiscDirectives$RouteConcatenation$$anonfun$$tilde$1.apply(MiscDirectives.scala:195)
              at cc.spray.directives.MiscDirectives$RouteConcatenation$$anonfun$$tilde$1.apply(MiscDirectives.scala:194)
              at cc.spray.directives.MiscDirectives$RouteConcatenation$$anonfun$$tilde$1.apply(MiscDirectives.scala:195)
              at cc.spray.directives.MiscDirectives$RouteConcatenation$$anonfun$$tilde$1.apply(MiscDirectives.scala:194)
              at cc.spray.directives.SprayRoute$$anonfun$fromRouting$1.apply(BasicDirectives.scala:104)
              at cc.spray.directives.SprayRoute$$anonfun$fromRouting$1.apply(BasicDirectives.scala:102)
              at cc.spray.HttpServiceLogic$class.handle(HttpServiceLogic.scala:43)
              at cc.spray.HttpService.handle(HttpServiceActor.scala:49)
              at cc.spray.HttpServiceActor$$anonfun$receive$1.apply(HttpServiceActor.scala:41)
              at cc.spray.HttpServiceActor$$anonfun$receive$1.apply(HttpServiceActor.scala:40)
              at akka.actor.Actor$class.apply(Actor.scala:318)
              at cc.spray.HttpService.apply(HttpServiceActor.scala:49)
              at akka.actor.ActorCell.invoke(ActorCell.scala:626)
              at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:197)
              at akka.dispatch.Mailbox.run(Mailbox.scala:179)
              at akka.dispatch.ForkJoinExecutorConfigurator$MailboxExecutionTask.exec(AbstractDispatcher.scala:516)
              at akka.jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:259)
              at akka.jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975)
              at akka.jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1479)
              at akka.jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            aht Hai-Anh Trinh
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: