Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-806

Application goes into infinite loop after success, waits for: Waiting for org.apache.giraph.utils.ProgressableUtils

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.1.0
    • Fix Version/s: None
    • Component/s: examples, mapreduce
    • Labels:

      Description

      Run example:

      hadoop jar giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0.2.0.6.0-76-jar-with-dependencies.jar org.apache.giraph.GiraphRunner -D giraph.zkList="zkNode.net:2181" -D yarn.app.mapreduce.am.log.level=DEBUG -D mapreduce.map.log.level=DEBUG -D mapreduce.reduce.log.level=DEBUG org.apache.giraph.examples.SimplePageRankComputation -w 1 -yh 1024 -yj ./giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0.2.0.6.0-76-jar-with-dependencies.jar -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -mc org.apache.giraph.examples.SimplePageRankComputation\$SimplePageRankMasterCompute -vip /user/rav/giraph/input/giraph.in -op /user/rav/giraph/output
      

      After application successfully computer result it goes to infinite loop of:

      2013-11-28 20:09:51,764 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.master.BspServiceMaster: setJobState: {"_stateKey":"FINISHED","_applicationAttemptKey":-1,"_superstepKey":-1} on superstep 31
      2013-11-28 20:09:51,821 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.master.BspServiceMaster: cleanup: Notifying master its okay to cleanup with /_hadoopBsp/job_1385571160481_11413/_cleanedUpDir/0_master
      2013-11-28 20:09:51,829 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.master.BspServiceMaster: cleanUpZooKeeper: Node /_hadoopBsp/job_1385571160481_11413/_cleanedUpDir already exists, no need to create.
      2013-11-28 20:09:51,831 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.master.BspServiceMaster: cleanUpZooKeeper: Got 1 of 2 desired children from /_hadoopBsp/job_1385571160481_11413/_cleanedUpDir
      2013-11-28 20:09:51,831 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.master.BspServiceMaster: cleanedUpZooKeeper: Waiting for the children of /_hadoopBsp/job_1385571160481_11413/_cleanedUpDir to change since only got 1 nodes.
      2013-11-28 20:09:51,909 INFO [main-EventThread] org.apache.giraph.bsp.BspService: process: cleanedUpChildrenChanged signaled
      2013-11-28 20:09:51,910 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.master.BspServiceMaster: cleanUpZooKeeper: Got 2 of 2 desired children from /_hadoopBsp/job_1385571160481_11413/_cleanedUpDir
      2013-11-28 20:09:51,911 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.master.BspServiceMaster: cleanupZooKeeper: Removing the following path and all children - /_hadoopBsp/job_1385571160481_11413 from ZooKeeper list zkNode.net:2181
      2013-11-28 20:09:52,329 INFO [main-EventThread] org.apache.giraph.bsp.BspService: process: masterElectionChildrenChanged signaled
      2013-11-28 20:09:52,379 INFO [main-EventThread] org.apache.giraph.bsp.BspService: process: cleanedUpChildrenChanged signaled
      2013-11-28 20:09:52,447 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.master.BspServiceMaster: cleanup: Removed HDFS checkpoint directory (_bsp/_checkpoints//job_1385571160481_11413) with return = false since the job Giraph: org.apache.giraph.examples.SimplePageRankComputation succeeded 
      2013-11-28 20:09:52,449 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.comm.netty.NettyClient: stop: reached wait threshold, 1 connections closed, releasing NettyClient.bootstrap resources now.
      2013-11-28 20:09:52,454 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.comm.netty.NettyServer: stop: Halting netty server
      2013-11-28 20:10:52,463 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:11:52,463 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:12:52,463 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:13:52,464 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:14:52,464 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:15:52,464 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:16:52,465 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:17:52,465 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:18:52,465 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:19:52,466 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:20:52,466 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:21:52,466 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      2013-11-28 20:22:52,467 INFO [org.apache.giraph.master.MasterThread] org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$ExecutorServiceWaitable@2f368c5d
      

        Attachments

        1. GIRAPH-806.patch
          3 kB
          Wojciech Indyk

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ravwojdyla Rafal Wojdyla
            • Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated: