Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-448

orphan process left on DataNode

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.1.0
    • Fix Version/s: None
    • Component/s: mapreduce
    • Labels:
      None
    • Environment:

      Hadoop 1.0 with Fedora linux OS

      Description

      I am able to run some simple Graph job successfully but there is one orphan process left on the data node per job run.

      Please advise.

      Really appreciated your time and help.

      Min

      ----- details ------------------

      My job:
      hadoop jar /usr/local/giraph-0.1/lib/giraph-0.1.jar org.apache.giraph.examples.SimpleShortestPathsVertex -Dgiraph.zkList="10.244.140.108:22181,10.244.141.225:22181,10.244.140.161:22181" -libjars /usr/local/giraph-0.1//lib/guava-r09.jar,/usr/local/giraph-0.1//lib/zookeeper-3.3.3.jar,/home/mitu/jars/commons-io-2.1.jar,/home/mitu/json-20090211.jar,/home/mitu/gson-2.2.2.jar,/usr/local/giraph-0.1/lib/base64-2.3.8.jar -Dquorum=d-sjc-00513560.corp.ebay.com /user/mitu/giraphData/sssp/input /user/mitu/giraphData/sssp/output 1 2

      --------------
      Process left on the data node after job FINISHED successfully

      mapred 24885 24004 5 16:47 ? 00:00:04 /usr/java/jdk1.6.0_35/jre/bin/java -Djava.library.path=/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/native/Linux-amd64-64:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/attempt_201212101618_0003_m_000001_0/work -Xmx2g -Djava.io.tmpdir=/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/attempt_201212101618_0003_m_000001_0/work/tmp -classpath /usr/local/hadoop-0.20.2-cdh3u4a/conf:/usr/java/default//lib/tools.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/..:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../hadoop-core-0.20.2-cdh3u4a.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/ant-contrib-1.0b3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/aspectjrt-1.6.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-cli-1.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-daemon-1.0.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-el-1.0.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-httpclient-3.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-logging-1.0.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-logging-api-1.0.4.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/commons-net-3.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/core-3.1.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/guava-r09-jarjar.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/hadoop-fairscheduler-0.20.2-cdh3u4a.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jackson-core-asl-1.7.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jackson-mapper-asl-1.7.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jasper-compiler-5.5.12.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-servlet-tester-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jetty-util-6.1.26.cloudera.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsch-0.1.42.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/junit-4.5.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/log4j-1.2.15.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/mockito-all-1.8.2.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/servlet-api-2.5-20081211.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/xmlenc-0.52.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/bin/../lib/jsp-2.1/jsp-api-2.1.jar:/usr/local/hadoop-0.20.2-cdh3u4a/conf/sflowagent.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/jars/classes:/usr/local/hadoop01/scratch/taskTracker/mitu/jobcache/job_201212101618_0003/jars/job.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/-1938241819864817775_-1820091806_124600052/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/guava-r09.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/3379343582640146181_1388448658_124600217/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/zookeeper-3.3.3.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/8554092968028345678_-45346133_124600290/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapred/mapred/staging/mitu/.staging/job_201212101618_0003/libjars/commons-io-2.1.jar:/usr/local/hadoop01/scratch/taskTracker/mitu/distcache/-8215982196372453677_936989764_124600348/d-sjc-00513560.corp.ebay.com/tmp/hadoop-mapre
      mapred 25042 21916 0 16:48 pts/0 00:00:00 grep --color=auto 24885

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              mintu Min Tu
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: