Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6640

mapred job -history command should be able to take Job ID

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: client
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The mapred job -history command currently accepts only a jobHistoryFile>. It would be much easier for the user if it could also accept a Job ID so the user doesn't have to go and find the jhist file. It would also be more consistent with the other commands, which generally take a Job ID.

      1. MAPREDUCE-6640.001.patch
        121 kB
        Robert Kanter
      2. MAPREDUCE-6640.002.patch
        127 kB
        Robert Kanter

        Issue Links

          Activity

          Hide
          rkanter Robert Kanter added a comment -

          The patch makes it so that instead of <jobHistoryFile>, it's now <jobHistoryFile|jobId>. When given a Job ID, it will fetch the Job's info and use that to look up the jhist file location, and then use the old existing behavior on that file. Besides the obvious changes required for that, I also had to fix the broken API that should have returned the jhist file location, which wasn't hooked up before.

          The patch is somewhat large because it deletes a jhist file that's no longer needed by any unit tests.

          Show
          rkanter Robert Kanter added a comment - The patch makes it so that instead of <jobHistoryFile> , it's now <jobHistoryFile|jobId> . When given a Job ID, it will fetch the Job's info and use that to look up the jhist file location, and then use the old existing behavior on that file. Besides the obvious changes required for that, I also had to fix the broken API that should have returned the jhist file location, which wasn't hooked up before. The patch is somewhat large because it deletes a jhist file that's no longer needed by any unit tests.
          Hide
          rkanter Robert Kanter added a comment -

          Not sure why Jenkins didn't run for this. I've manually kicked it off now.

          Show
          rkanter Robert Kanter added a comment - Not sure why Jenkins didn't run for this. I've manually kicked it off now.
          Hide
          kasha Karthik Kambatla added a comment -

          This should improve the usability of the CLI quite a bit. Patch looks mostly good. Minor comments:

          1. The CLI should set the exit code for the case user invokes using jobID but the history file for the job could not be found.
          2. HistoryViewer has a spurious import.
          Show
          kasha Karthik Kambatla added a comment - This should improve the usability of the CLI quite a bit. Patch looks mostly good. Minor comments: The CLI should set the exit code for the case user invokes using jobID but the history file for the job could not be found. HistoryViewer has a spurious import.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 11s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 2 new or modified test files.
          0 mvndep 0m 9s Maven dependency ordering for branch
          +1 mvninstall 7m 26s trunk passed
          +1 compile 1m 43s trunk passed with JDK v1.8.0_72
          +1 compile 1m 49s trunk passed with JDK v1.7.0_95
          +1 checkstyle 0m 31s trunk passed
          +1 mvnsite 1m 52s trunk passed
          +1 mvneclipse 0m 54s trunk passed
          +1 findbugs 2m 55s trunk passed
          +1 javadoc 1m 13s trunk passed with JDK v1.8.0_72
          +1 javadoc 1m 24s trunk passed with JDK v1.7.0_95
          0 mvndep 0m 10s Maven dependency ordering for patch
          +1 mvninstall 1m 31s the patch passed
          +1 compile 1m 46s the patch passed with JDK v1.8.0_72
          +1 cc 1m 46s the patch passed
          +1 javac 1m 46s the patch passed
          +1 compile 1m 49s the patch passed with JDK v1.7.0_95
          +1 cc 1m 49s the patch passed
          +1 javac 1m 49s the patch passed
          -1 checkstyle 0m 28s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 14 new + 484 unchanged - 4 fixed = 498 total (was 488)
          +1 mvnsite 1m 46s the patch passed
          +1 mvneclipse 0m 46s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 3m 49s the patch passed
          +1 javadoc 1m 3s the patch passed with JDK v1.8.0_72
          +1 javadoc 1m 14s the patch passed with JDK v1.7.0_95
          +1 unit 2m 7s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_72.
          +1 unit 0m 44s hadoop-mapreduce-client-common in the patch passed with JDK v1.8.0_72.
          -1 unit 5m 54s hadoop-mapreduce-client-hs in the patch failed with JDK v1.8.0_72.
          -1 unit 106m 51s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.8.0_72.
          -1 unit 2m 34s hadoop-mapreduce-client-core in the patch failed with JDK v1.7.0_95.
          +1 unit 0m 57s hadoop-mapreduce-client-common in the patch passed with JDK v1.7.0_95.
          -1 unit 6m 15s hadoop-mapreduce-client-hs in the patch failed with JDK v1.7.0_95.
          -1 unit 107m 17s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.7.0_95.
          -1 asflicense 0m 28s Patch generated 31 ASF License warnings.
          269m 18s



          Reason Tests
          JDK v1.8.0_72 Failed junit tests hadoop.mapreduce.v2.hs.TestJobHistoryEntities
            hadoop.mapreduce.v2.hs.webapp.dao.TestJobInfo
            hadoop.mapreduce.v2.TestMRJobsWithProfiler
            hadoop.mapred.TestNetworkedJob
          JDK v1.7.0_95 Failed junit tests hadoop.mapreduce.tools.TestCLI
            hadoop.mapreduce.v2.hs.TestJobHistoryEntities
            hadoop.mapreduce.v2.hs.webapp.dao.TestJobInfo
            hadoop.mapred.TestNetworkedJob



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12788765/MAPREDUCE-6640.001.patch
          JIRA Issue MAPREDUCE-6640
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
          uname Linux df3bda88ef38 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 66289a3
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.8.0_72.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_72.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.7.0_95.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_95.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.7.0_95.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_95.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/testReport/
          asflicense https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
          Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/console
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 11s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 2 new or modified test files. 0 mvndep 0m 9s Maven dependency ordering for branch +1 mvninstall 7m 26s trunk passed +1 compile 1m 43s trunk passed with JDK v1.8.0_72 +1 compile 1m 49s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 31s trunk passed +1 mvnsite 1m 52s trunk passed +1 mvneclipse 0m 54s trunk passed +1 findbugs 2m 55s trunk passed +1 javadoc 1m 13s trunk passed with JDK v1.8.0_72 +1 javadoc 1m 24s trunk passed with JDK v1.7.0_95 0 mvndep 0m 10s Maven dependency ordering for patch +1 mvninstall 1m 31s the patch passed +1 compile 1m 46s the patch passed with JDK v1.8.0_72 +1 cc 1m 46s the patch passed +1 javac 1m 46s the patch passed +1 compile 1m 49s the patch passed with JDK v1.7.0_95 +1 cc 1m 49s the patch passed +1 javac 1m 49s the patch passed -1 checkstyle 0m 28s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 14 new + 484 unchanged - 4 fixed = 498 total (was 488) +1 mvnsite 1m 46s the patch passed +1 mvneclipse 0m 46s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 3m 49s the patch passed +1 javadoc 1m 3s the patch passed with JDK v1.8.0_72 +1 javadoc 1m 14s the patch passed with JDK v1.7.0_95 +1 unit 2m 7s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_72. +1 unit 0m 44s hadoop-mapreduce-client-common in the patch passed with JDK v1.8.0_72. -1 unit 5m 54s hadoop-mapreduce-client-hs in the patch failed with JDK v1.8.0_72. -1 unit 106m 51s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.8.0_72. -1 unit 2m 34s hadoop-mapreduce-client-core in the patch failed with JDK v1.7.0_95. +1 unit 0m 57s hadoop-mapreduce-client-common in the patch passed with JDK v1.7.0_95. -1 unit 6m 15s hadoop-mapreduce-client-hs in the patch failed with JDK v1.7.0_95. -1 unit 107m 17s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.7.0_95. -1 asflicense 0m 28s Patch generated 31 ASF License warnings. 269m 18s Reason Tests JDK v1.8.0_72 Failed junit tests hadoop.mapreduce.v2.hs.TestJobHistoryEntities   hadoop.mapreduce.v2.hs.webapp.dao.TestJobInfo   hadoop.mapreduce.v2.TestMRJobsWithProfiler   hadoop.mapred.TestNetworkedJob JDK v1.7.0_95 Failed junit tests hadoop.mapreduce.tools.TestCLI   hadoop.mapreduce.v2.hs.TestJobHistoryEntities   hadoop.mapreduce.v2.hs.webapp.dao.TestJobInfo   hadoop.mapred.TestNetworkedJob Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12788765/MAPREDUCE-6640.001.patch JIRA Issue MAPREDUCE-6640 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux df3bda88ef38 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 66289a3 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.7.0_95.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_95.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.7.0_95.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs-jdk1.7.0_95.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/testReport/ asflicense https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6340/console Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          rkanter Robert Kanter added a comment -

          The 002 patch:

          • Fixed the extra import Karthik mentioned. The exit code defaults to -1, so there's no need to explicitly set it for the use case you mentioned; it's done implicitly.
          • fixes checkstyle other than the "Redundant 'public' modifier." ones in JobReport to be consistent with the existing code, the "More than 7 parameters" ones in JobStatus because that's how many arguments there are, and the "Method length is 388 lines" one in CLI because that's just how long it is
          • fixes related unit test failures (TestJobHistoryEntities and TestJobInfo)
          Show
          rkanter Robert Kanter added a comment - The 002 patch: Fixed the extra import Karthik mentioned. The exit code defaults to -1, so there's no need to explicitly set it for the use case you mentioned; it's done implicitly. fixes checkstyle other than the "Redundant 'public' modifier." ones in JobReport to be consistent with the existing code, the "More than 7 parameters" ones in JobStatus because that's how many arguments there are, and the "Method length is 388 lines" one in CLI because that's just how long it is fixes related unit test failures ( TestJobHistoryEntities and TestJobInfo )
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 14s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 4 new or modified test files.
          0 mvndep 0m 11s Maven dependency ordering for branch
          +1 mvninstall 6m 47s trunk passed
          +1 compile 1m 30s trunk passed with JDK v1.8.0_72
          +1 compile 1m 45s trunk passed with JDK v1.7.0_95
          +1 checkstyle 0m 29s trunk passed
          +1 mvnsite 1m 56s trunk passed
          +1 mvneclipse 0m 55s trunk passed
          +1 findbugs 2m 50s trunk passed
          +1 javadoc 1m 7s trunk passed with JDK v1.8.0_72
          +1 javadoc 1m 24s trunk passed with JDK v1.7.0_95
          0 mvndep 0m 10s Maven dependency ordering for patch
          +1 mvninstall 1m 30s the patch passed
          +1 compile 1m 27s the patch passed with JDK v1.8.0_72
          +1 cc 1m 27s the patch passed
          +1 javac 1m 27s the patch passed
          +1 compile 1m 37s the patch passed with JDK v1.7.0_95
          +1 cc 1m 37s the patch passed
          +1 javac 1m 37s the patch passed
          -1 checkstyle 0m 26s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 7 new + 324 unchanged - 22 fixed = 331 total (was 346)
          +1 mvnsite 1m 38s the patch passed
          +1 mvneclipse 0m 46s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 3m 27s the patch passed
          +1 javadoc 0m 58s the patch passed with JDK v1.8.0_72
          +1 javadoc 1m 14s the patch passed with JDK v1.7.0_95
          +1 unit 1m 55s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_72.
          +1 unit 0m 38s hadoop-mapreduce-client-common in the patch passed with JDK v1.8.0_72.
          +1 unit 5m 40s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_72.
          -1 unit 99m 55s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.8.0_72.
          +1 unit 2m 21s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95.
          +1 unit 0m 52s hadoop-mapreduce-client-common in the patch passed with JDK v1.7.0_95.
          +1 unit 6m 5s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95.
          -1 unit 105m 56s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.7.0_95.
          -1 asflicense 0m 30s Patch generated 29 ASF License warnings.
          257m 56s



          Reason Tests
          JDK v1.8.0_72 Failed junit tests hadoop.mapreduce.v2.TestMRJobsWithProfiler
            hadoop.mapred.TestNetworkedJob
          JDK v1.7.0_95 Failed junit tests hadoop.mapred.TestNetworkedJob
            hadoop.mapred.TestLocalMRNotification



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12789130/MAPREDUCE-6640.002.patch
          JIRA Issue MAPREDUCE-6640
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc
          uname Linux 03088fa06f40 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 27b7775
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_72.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/testReport/
          asflicense https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
          Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/console
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 14s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 4 new or modified test files. 0 mvndep 0m 11s Maven dependency ordering for branch +1 mvninstall 6m 47s trunk passed +1 compile 1m 30s trunk passed with JDK v1.8.0_72 +1 compile 1m 45s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 29s trunk passed +1 mvnsite 1m 56s trunk passed +1 mvneclipse 0m 55s trunk passed +1 findbugs 2m 50s trunk passed +1 javadoc 1m 7s trunk passed with JDK v1.8.0_72 +1 javadoc 1m 24s trunk passed with JDK v1.7.0_95 0 mvndep 0m 10s Maven dependency ordering for patch +1 mvninstall 1m 30s the patch passed +1 compile 1m 27s the patch passed with JDK v1.8.0_72 +1 cc 1m 27s the patch passed +1 javac 1m 27s the patch passed +1 compile 1m 37s the patch passed with JDK v1.7.0_95 +1 cc 1m 37s the patch passed +1 javac 1m 37s the patch passed -1 checkstyle 0m 26s hadoop-mapreduce-project/hadoop-mapreduce-client: patch generated 7 new + 324 unchanged - 22 fixed = 331 total (was 346) +1 mvnsite 1m 38s the patch passed +1 mvneclipse 0m 46s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 3m 27s the patch passed +1 javadoc 0m 58s the patch passed with JDK v1.8.0_72 +1 javadoc 1m 14s the patch passed with JDK v1.7.0_95 +1 unit 1m 55s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_72. +1 unit 0m 38s hadoop-mapreduce-client-common in the patch passed with JDK v1.8.0_72. +1 unit 5m 40s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_72. -1 unit 99m 55s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.8.0_72. +1 unit 2m 21s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95. +1 unit 0m 52s hadoop-mapreduce-client-common in the patch passed with JDK v1.7.0_95. +1 unit 6m 5s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95. -1 unit 105m 56s hadoop-mapreduce-client-jobclient in the patch failed with JDK v1.7.0_95. -1 asflicense 0m 30s Patch generated 29 ASF License warnings. 257m 56s Reason Tests JDK v1.8.0_72 Failed junit tests hadoop.mapreduce.v2.TestMRJobsWithProfiler   hadoop.mapred.TestNetworkedJob JDK v1.7.0_95 Failed junit tests hadoop.mapred.TestNetworkedJob   hadoop.mapred.TestLocalMRNotification Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12789130/MAPREDUCE-6640.002.patch JIRA Issue MAPREDUCE-6640 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc uname Linux 03088fa06f40 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 27b7775 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/testReport/ asflicense https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6342/console Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          rkanter Robert Kanter added a comment -

          Failed tests unrelated. Remaining checkstyle warnings are expected.

          Show
          rkanter Robert Kanter added a comment - Failed tests unrelated. Remaining checkstyle warnings are expected.
          Hide
          kasha Karthik Kambatla added a comment -

          +1

          Show
          kasha Karthik Kambatla added a comment - +1
          Hide
          rkanter Robert Kanter added a comment -

          Thanks for the review Karthik Kambatla. Committed to trunk and branch-2!

          Show
          rkanter Robert Kanter added a comment - Thanks for the review Karthik Kambatla . Committed to trunk and branch-2!
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-trunk-Commit #9358 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9358/)
          MAPREDUCE-6640. mapred job -history command should be able to take Job (rkanter: rev 4343a4cf7790b47dc7ecd18f8634e6b9c805e775)

          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobStatus.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/resources/job_1329348432655_0001-10.jhist
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobStatus.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/dao/TestJobInfo.java
          • hadoop-mapreduce-project/CHANGES.txt
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryFileManager.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/tools/CLI.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryEntities.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-trunk-Commit #9358 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9358/ ) MAPREDUCE-6640 . mapred job -history command should be able to take Job (rkanter: rev 4343a4cf7790b47dc7ecd18f8634e6b9c805e775) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/impl/pb/JobReportPBImpl.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapredCommands.md hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobStatus.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/resources/job_1329348432655_0001-10.jhist hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobStatus.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/dao/TestJobInfo.java hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryFileManager.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/tools/CLI.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/proto/mr_protos.proto hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/api/records/JobReport.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryEntities.java

            People

            • Assignee:
              rkanter Robert Kanter
              Reporter:
              rkanter Robert Kanter
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development