Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2791

[MR-279] Missing/incorrect info on job -status CLI

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None

      Description

      There are a couple of details missing/incorrect on the job -status command line output for completed jobs:

      1. Incorrect job file
      2. map() completion is always 0
      3. reduce() completion is always set to 0
      4. history URL is empty
      5. Missing launched map tasks
      6. Missing launched reduce tasks

      1. MAPREDUCE-2791.patch
        19 kB
        Arun C Murthy
      2. MAPREDUCE-2791.patch
        14 kB
        Devaraj K
      3. MAPREDUCE-2791-1.patch
        13 kB
        Devaraj K
      4. MAPREDUCE-2791-1.patch
        13 kB
        Devaraj K
      5. MAPREDUCE-2791-2.patch
        14 kB
        Devaraj K
      6. MAPREDUCE-2791-3.patch
        13 kB
        Devaraj K
      7. MAPREDUCE-2791-4.patch
        17 kB
        Devaraj K
      8. MAPREDUCE-2791-5.patch
        17 kB
        Devaraj K
      9. mvn install.log
        84 kB
        Devaraj K

        Issue Links

          Activity

          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #846 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/846/)
          MAPREDUCE-2791. Added missing info on 'job -status' output. Contributed by Devaraj K.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177487
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #846 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/846/ ) MAPREDUCE-2791 . Added missing info on 'job -status' output. Contributed by Devaraj K. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177487 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Build #32 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/32/)
          Merge -r 1177486:1177487 from trunk to branch-0.23 to fix MAPREDUCE-2791.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177490
          Files :

          • /hadoop/common/branches/branch-0.23
          • /hadoop/common/branches/branch-0.23/hadoop-common-project
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/docs
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/core
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/native
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/.gitignore
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf/capacity-scheduler.xml.template
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/c++
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/block_forensics
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build-contrib.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/capacity-scheduler
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/data_join
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/dynamic-scheduler
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/eclipse-plugin
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/fairscheduler
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/index
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/vaidya
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/examples
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/hdfs
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/FileBench.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/TestSequenceFileMergeProgress.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/ipc
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/security/authorize/TestServiceLevelAuthorization.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/test/MapredTestDriver.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/webapps/job
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #32 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/32/ ) Merge -r 1177486:1177487 from trunk to branch-0.23 to fix MAPREDUCE-2791 . acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177490 Files : /hadoop/common/branches/branch-0.23 /hadoop/common/branches/branch-0.23/hadoop-common-project /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/docs /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/core /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/native /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/.gitignore /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf/capacity-scheduler.xml.template /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/c++ /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/block_forensics /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build-contrib.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/capacity-scheduler /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/data_join /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/dynamic-scheduler /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/eclipse-plugin /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/fairscheduler /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/index /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/vaidya /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/examples /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/hdfs /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/FileBench.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/TestSequenceFileMergeProgress.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/ipc /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/security/authorize/TestServiceLevelAuthorization.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/test/MapredTestDriver.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/webapps/job
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Build #25 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/25/)
          Merge -r 1177486:1177487 from trunk to branch-0.23 to fix MAPREDUCE-2791.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177490
          Files :

          • /hadoop/common/branches/branch-0.23
          • /hadoop/common/branches/branch-0.23/hadoop-common-project
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/docs
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java
          • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/core
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/native
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/.gitignore
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf/capacity-scheduler.xml.template
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/c++
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/block_forensics
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build-contrib.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build.xml
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/capacity-scheduler
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/data_join
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/dynamic-scheduler
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/eclipse-plugin
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/fairscheduler
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/index
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/vaidya
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/examples
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/hdfs
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/FileBench.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/TestSequenceFileMergeProgress.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/ipc
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/security/authorize/TestServiceLevelAuthorization.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/test/MapredTestDriver.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/webapps/job
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #25 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/25/ ) Merge -r 1177486:1177487 from trunk to branch-0.23 to fix MAPREDUCE-2791 . acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177490 Files : /hadoop/common/branches/branch-0.23 /hadoop/common/branches/branch-0.23/hadoop-common-project /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/docs /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/core /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/native /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/datanode /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/hdfs /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/.gitignore /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/conf/capacity-scheduler.xml.template /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/c++ /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/block_forensics /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build-contrib.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/build.xml /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/capacity-scheduler /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/data_join /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/dynamic-scheduler /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/eclipse-plugin /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/fairscheduler /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/index /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/vaidya /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/examples /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/hdfs /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/FileBench.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/io/TestSequenceFileMergeProgress.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/ipc /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/security/authorize/TestServiceLevelAuthorization.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/test/MapredTestDriver.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/webapps/job
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #816 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/816/)
          MAPREDUCE-2791. Added missing info on 'job -status' output. Contributed by Devaraj K.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177487
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #816 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/816/ ) MAPREDUCE-2791 . Added missing info on 'job -status' output. Contributed by Devaraj K. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177487 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #1011 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1011/)
          MAPREDUCE-2791. Added missing info on 'job -status' output. Contributed by Devaraj K.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177487
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1011 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1011/ ) MAPREDUCE-2791 . Added missing info on 'job -status' output. Contributed by Devaraj K. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177487 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #1067 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1067/)
          MAPREDUCE-2791. Added missing info on 'job -status' output. Contributed by Devaraj K.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177487
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1067 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1067/ ) MAPREDUCE-2791 . Added missing info on 'job -status' output. Contributed by Devaraj K. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177487 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #989 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/989/)
          MAPREDUCE-2791. Added missing info on 'job -status' output. Contributed by Devaraj K.

          acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177487
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #989 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/989/ ) MAPREDUCE-2791 . Added missing info on 'job -status' output. Contributed by Devaraj K. acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1177487 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/JobImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestRMContainerAllocator.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRBuilderUtils.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestClientServiceDelegate.java
          Hide
          Arun C Murthy added a comment -

          I just committed this. Thanks Devaraj!

          Show
          Arun C Murthy added a comment - I just committed this. Thanks Devaraj!
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12497096/MAPREDUCE-2791.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 7 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/902//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/902//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12497096/MAPREDUCE-2791.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 7 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/902//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/902//console This message is automatically generated.
          Hide
          Arun C Murthy added a comment -

          Rebased. I'll commit once hudson +1s it.

          Thanks for being patient Devaraj!

          Show
          Arun C Murthy added a comment - Rebased. I'll commit once hudson +1s it. Thanks for being patient Devaraj!
          Hide
          Arun C Murthy added a comment -

          Unfortunately, the patch doesn't apply anymore. I'll upload rebased one presently...

          Show
          Arun C Murthy added a comment - Unfortunately, the patch doesn't apply anymore. I'll upload rebased one presently...
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12497015/MAPREDUCE-2791-5.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 7 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/896//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12497015/MAPREDUCE-2791-5.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 7 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/896//console This message is automatically generated.
          Hide
          Devaraj K added a comment -

          I'm sorry for the delay and disturbance to you.

          I ran 'ant test', failing few testcases in my environment(with timeout) which fails without patch also and those are not related to the patch changes. The above change doesn't impact the MR CLI tests because that history url is not referring any where in the code from the toString() method.

          I have moved the tracking url check to the ClientServiceDelegate.

          Thanks Arun.

          Show
          Devaraj K added a comment - I'm sorry for the delay and disturbance to you. I ran 'ant test', failing few testcases in my environment(with timeout) which fails without patch also and those are not related to the patch changes. The above change doesn't impact the MR CLI tests because that history url is not referring any where in the code from the toString() method. I have moved the tracking url check to the ClientServiceDelegate. Thanks Arun.
          Hide
          Arun C Murthy added a comment -

          Sorry to give you a hard time on this, but I really think we are close.

          I can be up for another hour or so if you can fix the last nit and I'll commit. Thanks!

          Show
          Arun C Murthy added a comment - Sorry to give you a hard time on this, but I really think we are close. I can be up for another hour or so if you can fix the last nit and I'll commit. Thanks!
          Hide
          Arun C Murthy added a comment -

          Thanks Devaraj.

          Just to be careful, can u pls confirm the following change doesn't break any of the MR CLI tests:

          Index: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java
          ===================================================================
          --- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java	(revision 1177158)
          +++ hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java	(working copy)
          @@ -462,8 +462,6 @@
               sb.append(status.getReduceProgress()).append("\n");
               sb.append("Job state: ");
               sb.append(status.getState()).append("\n");
          -    sb.append("history URL: ");
          -    sb.append(status.getHistoryFile()).append("\n");
               sb.append("retired: ").append(status.isRetired()).append("\n");
               sb.append("reason for failure: ").append(reasonforFailure);
               return sb.toString();
          

          Also, shouldn't we do the check of amTrackingUrl v/s historyTrackingUrl in ClientServiceDelegate rather than in TypeConvertor.fromYarn? That way TypeConvertor is simple.

          Show
          Arun C Murthy added a comment - Thanks Devaraj. Just to be careful, can u pls confirm the following change doesn't break any of the MR CLI tests: Index: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java =================================================================== --- hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java (revision 1177158) +++ hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java (working copy) @@ -462,8 +462,6 @@ sb.append(status.getReduceProgress()).append("\n"); sb.append("Job state: "); sb.append(status.getState()).append("\n"); - sb.append("history URL: "); - sb.append(status.getHistoryFile()).append("\n"); sb.append("retired: ").append(status.isRetired()).append("\n"); sb.append("reason for failure: ").append(reasonforFailure); return sb.toString(); Also, shouldn't we do the check of amTrackingUrl v/s historyTrackingUrl in ClientServiceDelegate rather than in TypeConvertor.fromYarn? That way TypeConvertor is simple.
          Hide
          Devaraj K added a comment -

          I have attached the mvn install report.

          Show
          Devaraj K added a comment - I have attached the mvn install report.
          Hide
          Devaraj K added a comment -

          Hi Arun, I ran 'mvn install' and 'ant test' in local, all tests passed.

          The running job output is this. It was my copy paste problem in the above.

          {code:title=Running Job |borderStyle=solid}
          Job: job_1317173942118_0002
          Job File: hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/job_1317173942118_0002/job.xml
          Job Tracking URL : http://10.18.52.124:13740
          map() completion: 1.0
          reduce() completion: 0.0
          Job state: RUNNING
          retired: false
          reason for failure:
          ........
          
          Show
          Devaraj K added a comment - Hi Arun, I ran 'mvn install' and 'ant test' in local, all tests passed. The running job output is this. It was my copy paste problem in the above. {code:title=Running Job |borderStyle=solid} Job: job_1317173942118_0002 Job File: hdfs: //10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/job_1317173942118_0002/job.xml Job Tracking URL : http: //10.18.52.124:13740 map() completion: 1.0 reduce() completion: 0.0 Job state: RUNNING retired: false reason for failure: ........
          Hide
          Devaraj K added a comment -

          Latest Output:

          Completed Job
          Job: job_1317173942118_0001
          Job File: hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/history/done_intermediate/root/job_1317173942118_0001_conf.xml
          Job Tracking URL : http://10.18.52.124:19888/jobhistory/job/job_1317173942118_1_1
          map() completion: 1.0
          reduce() completion: 1.0
          Job state: SUCCEEDED
          retired: false
          reason for failure:
          Counters: 43
                  File System Counters
                          FILE: BYTES_READ=16470
                          FILE: BYTES_WRITTEN=110802
                          FILE: READ_OPS=0
                          FILE: LARGE_READ_OPS=0
                          FILE: WRITE_OPS=0
                          HDFS: BYTES_READ=8782
                          HDFS: BYTES_WRITTEN=6503
                          HDFS: READ_OPS=9
                          HDFS: LARGE_READ_OPS=0
                          HDFS: WRITE_OPS=4
                  org.apache.hadoop.mapreduce.JobCounter
                          TOTAL_LAUNCHED_MAPS=1
                          TOTAL_LAUNCHED_REDUCES=1
                          DATA_LOCAL_MAPS=1
                          SLOTS_MILLIS_MAPS=5248
                          SLOTS_MILLIS_REDUCES=6856
                  org.apache.hadoop.mapreduce.TaskCounter
                          MAP_INPUT_RECORDS=243
                          MAP_OUTPUT_RECORDS=874
                          MAP_OUTPUT_BYTES=11541
                          MAP_OUTPUT_MATERIALIZED_BYTES=8115
                          SPLIT_RAW_BYTES=94
                          COMBINE_INPUT_RECORDS=874
                          COMBINE_OUTPUT_RECORDS=405
                          REDUCE_INPUT_GROUPS=405
                          REDUCE_SHUFFLE_BYTES=8115
                          REDUCE_INPUT_RECORDS=405
                          REDUCE_OUTPUT_RECORDS=405
                          SPILLED_RECORDS=810
                          SHUFFLED_MAPS=1
                          FAILED_SHUFFLE=0
                          MERGED_MAP_OUTPUTS=1
                          GC_TIME_MILLIS=47
                          CPU_MILLISECONDS=3680
                          PHYSICAL_MEMORY_BYTES=290209792
                          VIRTUAL_MEMORY_BYTES=1027088384
                          COMMITTED_HEAP_BYTES=168689664
                  Shuffle Errors
                          BAD_ID=0
                          CONNECTION=0
                          IO_ERROR=0
                          WRONG_LENGTH=0
                          WRONG_MAP=0
                          WRONG_REDUCE=0
                  org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter
                          BYTES_READ=8688
                  org.apache.hadoop.mapreduce.lib.output.FileOutputFormatCounter
                          BYTES_WRITTEN=6503
          
          Running Job
          Job: job_1317173942118_0002
          Job File: hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/jo                                                                                                                               b_1317173942118_0002/job.xml
          Job Tracking URL : http://10.18.52.124:13740
          map() completion: 1.0
          reduce() completion: 0.0
          Job state: RUNNING
          retired: false
          reason for failure:
          Counters: 30
                  File System Counters
                          FILE: BYTES_READ=8235
                          FILE: BYTES_WRITTEN=59474
                          FILE: READ_OPS=0
                          FILE: LARGE_READ_OPS=0
                          FILE: WRITE_OPS=0
                          HDFS: BYTES_READ=8782
                          HDFS: BYTES_WRITTEN=0
                          HDFS: READ_OPS=3
                          HDFS: LARGE_READ_OPS=0
                          HDFS: WRITE_OPS=0
                  org.apache.hadoop.mapreduce.JobCounter
                          TOTAL_LAUNCHED_MAPS=1
                          TOTAL_LAUNCHED_REDUCES=1
                          DATA_LOCAL_MAPS=1
                          SLOTS_MILLIS_MAPS=5289
                  org.apache.hadoop.mapreduce.TaskCounter
                          MAP_INPUT_RECORDS=243
                          MAP_OUTPUT_RECORDS=874
                          MAP_OUTPUT_BYTES=11541
                          MAP_OUTPUT_MATERIALIZED_BYTES=8115
                          SPLIT_RAW_BYTES=94
                          COMBINE_INPUT_RECORDS=874
                          COMBINE_OUTPUT_RECORDS=405
                          SPILLED_RECORDS=405
                          FAILED_SHUFFLE=0
                          MERGED_MAP_OUTPUTS=0
                          GC_TIME_MILLIS=20
                          CPU_MILLISECONDS=1040
                          PHYSICAL_MEMORY_BYTES=194613248
                          VIRTUAL_MEMORY_BYTES=501895168
                          COMMITTED_HEAP_BYTES=136970240
                  org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter
                          BYTES_READ=8688
          
          Show
          Devaraj K added a comment - Latest Output: Completed Job Job: job_1317173942118_0001 Job File: hdfs: //10.18.52.124:9000/tmp/hadoop-yarn/root/staging/history/done_intermediate/root/job_1317173942118_0001_conf.xml Job Tracking URL : http: //10.18.52.124:19888/jobhistory/job/job_1317173942118_1_1 map() completion: 1.0 reduce() completion: 1.0 Job state: SUCCEEDED retired: false reason for failure: Counters: 43 File System Counters FILE: BYTES_READ=16470 FILE: BYTES_WRITTEN=110802 FILE: READ_OPS=0 FILE: LARGE_READ_OPS=0 FILE: WRITE_OPS=0 HDFS: BYTES_READ=8782 HDFS: BYTES_WRITTEN=6503 HDFS: READ_OPS=9 HDFS: LARGE_READ_OPS=0 HDFS: WRITE_OPS=4 org.apache.hadoop.mapreduce.JobCounter TOTAL_LAUNCHED_MAPS=1 TOTAL_LAUNCHED_REDUCES=1 DATA_LOCAL_MAPS=1 SLOTS_MILLIS_MAPS=5248 SLOTS_MILLIS_REDUCES=6856 org.apache.hadoop.mapreduce.TaskCounter MAP_INPUT_RECORDS=243 MAP_OUTPUT_RECORDS=874 MAP_OUTPUT_BYTES=11541 MAP_OUTPUT_MATERIALIZED_BYTES=8115 SPLIT_RAW_BYTES=94 COMBINE_INPUT_RECORDS=874 COMBINE_OUTPUT_RECORDS=405 REDUCE_INPUT_GROUPS=405 REDUCE_SHUFFLE_BYTES=8115 REDUCE_INPUT_RECORDS=405 REDUCE_OUTPUT_RECORDS=405 SPILLED_RECORDS=810 SHUFFLED_MAPS=1 FAILED_SHUFFLE=0 MERGED_MAP_OUTPUTS=1 GC_TIME_MILLIS=47 CPU_MILLISECONDS=3680 PHYSICAL_MEMORY_BYTES=290209792 VIRTUAL_MEMORY_BYTES=1027088384 COMMITTED_HEAP_BYTES=168689664 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter BYTES_READ=8688 org.apache.hadoop.mapreduce.lib.output.FileOutputFormatCounter BYTES_WRITTEN=6503 Running Job Job: job_1317173942118_0002 Job File: hdfs: //10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/jo b_1317173942118_0002/job.xml Job Tracking URL : http: //10.18.52.124:13740 map() completion: 1.0 reduce() completion: 0.0 Job state: RUNNING retired: false reason for failure: Counters: 30 File System Counters FILE: BYTES_READ=8235 FILE: BYTES_WRITTEN=59474 FILE: READ_OPS=0 FILE: LARGE_READ_OPS=0 FILE: WRITE_OPS=0 HDFS: BYTES_READ=8782 HDFS: BYTES_WRITTEN=0 HDFS: READ_OPS=3 HDFS: LARGE_READ_OPS=0 HDFS: WRITE_OPS=0 org.apache.hadoop.mapreduce.JobCounter TOTAL_LAUNCHED_MAPS=1 TOTAL_LAUNCHED_REDUCES=1 DATA_LOCAL_MAPS=1 SLOTS_MILLIS_MAPS=5289 org.apache.hadoop.mapreduce.TaskCounter MAP_INPUT_RECORDS=243 MAP_OUTPUT_RECORDS=874 MAP_OUTPUT_BYTES=11541 MAP_OUTPUT_MATERIALIZED_BYTES=8115 SPLIT_RAW_BYTES=94 COMBINE_INPUT_RECORDS=874 COMBINE_OUTPUT_RECORDS=405 SPILLED_RECORDS=405 FAILED_SHUFFLE=0 MERGED_MAP_OUTPUTS=0 GC_TIME_MILLIS=20 CPU_MILLISECONDS=1040 PHYSICAL_MEMORY_BYTES=194613248 VIRTUAL_MEMORY_BYTES=501895168 COMMITTED_HEAP_BYTES=136970240 org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter BYTES_READ=8688
          Hide
          Arun C Murthy added a comment -

          Devaraj can u pls confirm you ran both 'ant test' and 'mvn install'? Tx

          Show
          Arun C Murthy added a comment - Devaraj can u pls confirm you ran both 'ant test' and 'mvn install'? Tx
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12496973/MAPREDUCE-2791-4.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 7 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/891//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12496973/MAPREDUCE-2791-4.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 7 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/891//console This message is automatically generated.
          Hide
          Arun C Murthy added a comment -

          Oh, you need to rebase too...

          Show
          Arun C Murthy added a comment - Oh, you need to rebase too...
          Hide
          Arun C Murthy added a comment -

          Devaraj, the patch looks good. Thanks!

          Can you please check why the patch can't be applied by hudson?

          Maybe it's got to do with ^M?

          If not, can you please run:

          1. mvn clean install to run all tests (incl. integration tests) and paste output?
          2. AlPlease run old tests i.e ant test to make sure.

          Also, can you pls paste the latest output? Thanks!

          Meanwhile I'll run this on a secure cluster to test.

          Show
          Arun C Murthy added a comment - Devaraj, the patch looks good. Thanks! Can you please check why the patch can't be applied by hudson? Maybe it's got to do with ^M? If not, can you please run: mvn clean install to run all tests (incl. integration tests) and paste output? AlPlease run old tests i.e ant test to make sure. Also, can you pls paste the latest output? Thanks! Meanwhile I'll run this on a secure cluster to test.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12496768/MAPREDUCE-2791-3.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 4 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/873//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12496768/MAPREDUCE-2791-3.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/873//console This message is automatically generated.
          Hide
          Devaraj K added a comment -

          I updated the patch as per the above suggestion.

          Show
          Devaraj K added a comment - I updated the patch as per the above suggestion.
          Hide
          Arun C Murthy added a comment -

          Thanks Devaraj!

          Show
          Arun C Murthy added a comment - Thanks Devaraj!
          Hide
          Devaraj K added a comment -

          It is fine Arun, any way History URL gives the complete information present in Job history file. This additional field can be removed.

          I will update the patch with these changes

          Show
          Devaraj K added a comment - It is fine Arun, any way History URL gives the complete information present in Job history file. This additional field can be removed. I will update the patch with these changes
          Hide
          Arun C Murthy added a comment -

          Devaraj - sorry if I wasn't clear.

          In MRv2 there is no history url until the job completes. Once the job completes there is no 'tracking url' since the MR AppMaster goes away.

          Thus, we can use the same field i.e. trackingUrl without adding another one.

          Makes sense?

          Show
          Arun C Murthy added a comment - Devaraj - sorry if I wasn't clear. In MRv2 there is no history url until the job completes. Once the job completes there is no 'tracking url' since the MR AppMaster goes away. Thus, we can use the same field i.e. trackingUrl without adding another one. Makes sense?
          Hide
          Devaraj K added a comment -

          Updated the patch based on the changes on the trunk. 'history URL' is renamed to 'History file URL'.

          Show
          Devaraj K added a comment - Updated the patch based on the changes on the trunk. 'history URL' is renamed to 'History file URL'.
          Hide
          Devaraj K added a comment -

          Thanks Arun for reviewing.

          trackingUrl == historyUrl for completed jobs.

          Here history URL is different from Tracking URL.

          history URL is the job history file location in the DFS for completed jobs and empty for Running Jobs. I feel the label can be renamed to "History file URL" for better readability.

          Show
          Devaraj K added a comment - Thanks Arun for reviewing. trackingUrl == historyUrl for completed jobs. Here history URL is different from Tracking URL. history URL is the job history file location in the DFS for completed jobs and empty for Running Jobs. I feel the label can be renamed to "History file URL" for better readability.
          Hide
          Arun C Murthy added a comment -

          Devaraj - we don't need both 'tracking url' and 'history url'.

          trackingUrl == historyUrl for completed jobs.

          Show
          Arun C Murthy added a comment - Devaraj - we don't need both 'tracking url' and 'history url'. trackingUrl == historyUrl for completed jobs.
          Hide
          Eric Payne added a comment -

          @Defaraj

          Several of the lines in the patch seem to have <ctl>-M (^M) at the end. Could that be it?

          Show
          Eric Payne added a comment - @Defaraj Several of the lines in the patch seem to have <ctl>-M (^M) at the end. Could that be it?
          Hide
          Devaraj K added a comment -

          Tried multiple times in local, no sure why it is failing to apply in Hudson.

          Show
          Devaraj K added a comment - Tried multiple times in local, no sure why it is failing to apply in Hudson.
          Hide
          Ravi Teja Ch N V added a comment -

          Able to apply this patch locally, checked with some other machines also. Not sure why applying of patch is failing in Jenkins. No logs also available.Any help?

          Show
          Ravi Teja Ch N V added a comment - Able to apply this patch locally, checked with some other machines also. Not sure why applying of patch is failing in Jenkins. No logs also available.Any help?
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12496123/MAPREDUCE-2791-1.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 4 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/825//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12496123/MAPREDUCE-2791-1.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/825//console This message is automatically generated.
          Hide
          Devaraj K added a comment -

          I am able to upload the patch properly in local. Reuploading the same patch to try again.

          Show
          Devaraj K added a comment - I am able to upload the patch properly in local. Reuploading the same patch to try again.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12496092/MAPREDUCE-2791-1.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 4 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/822//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12496092/MAPREDUCE-2791-1.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/822//console This message is automatically generated.
          Hide
          Devaraj K added a comment -

          Patch became stale, updated the patch.

          Show
          Devaraj K added a comment - Patch became stale, updated the patch.
          Hide
          Devaraj K added a comment -

          After applying the patch it displays the info like this.

          Completed Job
          Job: job_1316481926401_0006
          Job File: hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/history/done/2011/09/20/000000/job_1316481926401_0006_conf.xml
          Job Tracking URL : http://10.18.52.124:19888/yarn/job/job_1316481926401_6_6
          map() completion: 1.0
          reduce() completion: 1.0
          Job state: SUCCEEDED
          history URL: hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/history/done/2011/09/20/000000/job%5F1316481926401%5F0006_1316499355052_root_word+count_1316499371812_1_1_SUCCEEDED.jhist
          retired: false
          reason for failure:
          Counters: 43
                  File System Counters
                          FILE: BYTES_READ=16282
                          FILE: BYTES_WRITTEN=110724
                          FILE: READ_OPS=0
                          FILE: LARGE_READ_OPS=0
                          FILE: WRITE_OPS=0
                          HDFS: BYTES_READ=8620
                          HDFS: BYTES_WRITTEN=6421
                          HDFS: READ_OPS=9
                          HDFS: LARGE_READ_OPS=0
                          HDFS: WRITE_OPS=4
                  org.apache.hadoop.mapreduce.JobCounter
                          TOTAL_LAUNCHED_MAPS=1
                          TOTAL_LAUNCHED_REDUCES=1
          
          Running Job
          
          Job: job_1316510390966_0007
          Job File: hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/job_1316510390966_0007/job.xml
          Job Tracking URL : http://10.18.52.124:13270
          map() completion: 0.49555883
          reduce() completion: 0.0
          Job state: RUNNING
          history URL:
          retired: false
          reason for failure:
          Counters: 41
                  File System Counters
                          FILE: BYTES_READ=360
                          FILE: BYTES_WRITTEN=129952
                          FILE: READ_OPS=0
                          FILE: LARGE_READ_OPS=0
                          FILE: WRITE_OPS=0
                          HDFS: BYTES_READ=49061691
                          HDFS: BYTES_WRITTEN=0
                          HDFS: READ_OPS=4
                          HDFS: LARGE_READ_OPS=0
                          HDFS: WRITE_OPS=0
                  org.apache.hadoop.mapreduce.JobCounter
                          TOTAL_LAUNCHED_MAPS=2
                          TOTAL_LAUNCHED_REDUCES=1
                          DATA_LOCAL_MAPS=2
          
          

          1. Incorrect job file
          2. map() completion is always 0
          3. reduce() completion is always set to 0
          4. history URL is empty

          These issues have fixed as part of the patch.

          5. Missing launched map tasks
          6. Missing launched reduce tasks

          These details are already present in the report. No changes have done for this.

          Show
          Devaraj K added a comment - After applying the patch it displays the info like this. Completed Job Job: job_1316481926401_0006 Job File: hdfs: //10.18.52.124:9000/tmp/hadoop-yarn/root/staging/history/done/2011/09/20/000000/job_1316481926401_0006_conf.xml Job Tracking URL : http: //10.18.52.124:19888/yarn/job/job_1316481926401_6_6 map() completion: 1.0 reduce() completion: 1.0 Job state: SUCCEEDED history URL: hdfs: //10.18.52.124:9000/tmp/hadoop-yarn/root/staging/history/done/2011/09/20/000000/job%5F1316481926401%5F0006_1316499355052_root_word+count_1316499371812_1_1_SUCCEEDED.jhist retired: false reason for failure: Counters: 43 File System Counters FILE: BYTES_READ=16282 FILE: BYTES_WRITTEN=110724 FILE: READ_OPS=0 FILE: LARGE_READ_OPS=0 FILE: WRITE_OPS=0 HDFS: BYTES_READ=8620 HDFS: BYTES_WRITTEN=6421 HDFS: READ_OPS=9 HDFS: LARGE_READ_OPS=0 HDFS: WRITE_OPS=4 org.apache.hadoop.mapreduce.JobCounter TOTAL_LAUNCHED_MAPS=1 TOTAL_LAUNCHED_REDUCES=1 Running Job Job: job_1316510390966_0007 Job File: hdfs: //10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/job_1316510390966_0007/job.xml Job Tracking URL : http: //10.18.52.124:13270 map() completion: 0.49555883 reduce() completion: 0.0 Job state: RUNNING history URL: retired: false reason for failure: Counters: 41 File System Counters FILE: BYTES_READ=360 FILE: BYTES_WRITTEN=129952 FILE: READ_OPS=0 FILE: LARGE_READ_OPS=0 FILE: WRITE_OPS=0 HDFS: BYTES_READ=49061691 HDFS: BYTES_WRITTEN=0 HDFS: READ_OPS=4 HDFS: LARGE_READ_OPS=0 HDFS: WRITE_OPS=0 org.apache.hadoop.mapreduce.JobCounter TOTAL_LAUNCHED_MAPS=2 TOTAL_LAUNCHED_REDUCES=1 DATA_LOCAL_MAPS=2 1. Incorrect job file 2. map() completion is always 0 3. reduce() completion is always set to 0 4. history URL is empty These issues have fixed as part of the patch. 5. Missing launched map tasks 6. Missing launched reduce tasks These details are already present in the report. No changes have done for this.
          Hide
          Devaraj K added a comment -

          Provided the patch for review. Please review this patch.

          Show
          Devaraj K added a comment - Provided the patch for review. Please review this patch.

            People

            • Assignee:
              Devaraj K
              Reporter:
              Ramya Sunil
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development