Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6719

The list of -libjars archives should be replaced with a wildcard in the distributed cache to reduce the application footprint in the state store

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: distributed-cache
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When using the -libjars option to add classes to the classpath, every library so added is explicitly listed in the ContainerLaunchContext's local resources even though they're all uploaded to the same directory in HDFS. When using tools like Crunch without an uber JAR or when trying to take advantage of the shared cache, the number of libraries can be quite large. We've seen many cases where we had to turn down the max number of applications to prevent ZK from running out of heap because of the size of the state store entries.
      This JIRA proposes to allow for wildcards both in the internal processing of the -libjars switch and in paths added through the Job and DistributedCache classes. Rather than listing all files independently, this JIRA proposes to replace the complete list of libdir files with the wildcarded libdir directory, e.g. "libdir/*". This behavior is the same as the current behavior when using -libjars, but avoids explicitly listing every file.
      This capability will also be exposed by the DistributedCache.addCacheFile() method.
      See YARN-4958 for the NM side of the implementation and additional discussion.

      1. MAPREDUCE-6719.001.patch
        46 kB
        Daniel Templeton
      2. MAPREDUCE-6719.002.patch
        46 kB
        Daniel Templeton

        Issue Links

          Activity

          Hide
          templedf Daniel Templeton added a comment -

          This patch is based on patch 3 from YARN-4958 plus Sangjin Lee's suggestions. I tested, and it does work with the local job runner.

          Show
          templedf Daniel Templeton added a comment - This patch is based on patch 3 from YARN-4958 plus Sangjin Lee 's suggestions. I tested, and it does work with the local job runner.
          Hide
          sjlee0 Sangjin Lee added a comment -
          diff --git hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/nbproject/project.properties hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/nbproject/project.properties
          new file mode 100644
          index 0000000..e69de29
          

          Is the above file supposed to be part of this patch? It seems to me that either the file's content should be in the patch or it should be removed from the patch.

          Show
          sjlee0 Sangjin Lee added a comment - diff --git hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/nbproject/project.properties hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/nbproject/project.properties new file mode 100644 index 0000000..e69de29 Is the above file supposed to be part of this patch? It seems to me that either the file's content should be in the patch or it should be removed from the patch.
          Hide
          templedf Daniel Templeton added a comment -

          Whoops. Removed the extra file.

          Show
          templedf Daniel Templeton added a comment - Whoops. Removed the extra file.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 28s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 4 new or modified test files.
          0 mvndep 0m 7s Maven dependency ordering for branch
          +1 mvninstall 10m 12s trunk passed
          +1 compile 2m 9s trunk passed
          +1 checkstyle 0m 36s trunk passed
          +1 mvnsite 1m 51s trunk passed
          +1 mvneclipse 0m 45s trunk passed
          +1 findbugs 2m 25s trunk passed
          +1 javadoc 1m 15s trunk passed
          0 mvndep 0m 9s Maven dependency ordering for patch
          +1 mvninstall 1m 23s the patch passed
          +1 compile 1m 59s the patch passed
          -1 javac 1m 59s hadoop-mapreduce-project_hadoop-mapreduce-client generated 23 new + 341 unchanged - 0 fixed = 364 total (was 341)
          +1 checkstyle 0m 41s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 0 new + 193 unchanged - 16 fixed = 193 total (was 209)
          +1 mvnsite 1m 29s the patch passed
          +1 mvneclipse 0m 44s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 xml 0m 2s The patch has no ill-formed XML file.
          +1 findbugs 2m 50s the patch passed
          +1 javadoc 0m 23s hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core generated 0 new + 2508 unchanged - 1 fixed = 2508 total (was 2509)
          +1 javadoc 0m 22s hadoop-mapreduce-client-common in the patch passed.
          +1 javadoc 0m 12s hadoop-mapreduce-client-jobclient in the patch passed.
          +1 unit 2m 21s hadoop-mapreduce-client-core in the patch passed.
          +1 unit 0m 59s hadoop-mapreduce-client-common in the patch passed.
          -1 unit 128m 9s hadoop-mapreduce-client-jobclient in the patch failed.
          -1 asflicense 0m 25s The patch generated 1 ASF License warnings.
          163m 8s



          Reason Tests
          Timed out junit tests org.apache.hadoop.mapreduce.lib.jobcontrol.TestMapReduceJobControl



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:e2f6409
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12811852/MAPREDUCE-6719.001.patch
          JIRA Issue MAPREDUCE-6719
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux d71afc3bdec8 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 5107a96
          Default Java 1.8.0_91
          findbugs v3.0.0
          javac https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/artifact/patchprocess/diff-compile-javac-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
          unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
          Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/testReport/
          asflicense https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
          Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/console
          Powered by Apache Yetus 0.3.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 28s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 4 new or modified test files. 0 mvndep 0m 7s Maven dependency ordering for branch +1 mvninstall 10m 12s trunk passed +1 compile 2m 9s trunk passed +1 checkstyle 0m 36s trunk passed +1 mvnsite 1m 51s trunk passed +1 mvneclipse 0m 45s trunk passed +1 findbugs 2m 25s trunk passed +1 javadoc 1m 15s trunk passed 0 mvndep 0m 9s Maven dependency ordering for patch +1 mvninstall 1m 23s the patch passed +1 compile 1m 59s the patch passed -1 javac 1m 59s hadoop-mapreduce-project_hadoop-mapreduce-client generated 23 new + 341 unchanged - 0 fixed = 364 total (was 341) +1 checkstyle 0m 41s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 0 new + 193 unchanged - 16 fixed = 193 total (was 209) +1 mvnsite 1m 29s the patch passed +1 mvneclipse 0m 44s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 2s The patch has no ill-formed XML file. +1 findbugs 2m 50s the patch passed +1 javadoc 0m 23s hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core generated 0 new + 2508 unchanged - 1 fixed = 2508 total (was 2509) +1 javadoc 0m 22s hadoop-mapreduce-client-common in the patch passed. +1 javadoc 0m 12s hadoop-mapreduce-client-jobclient in the patch passed. +1 unit 2m 21s hadoop-mapreduce-client-core in the patch passed. +1 unit 0m 59s hadoop-mapreduce-client-common in the patch passed. -1 unit 128m 9s hadoop-mapreduce-client-jobclient in the patch failed. -1 asflicense 0m 25s The patch generated 1 ASF License warnings. 163m 8s Reason Tests Timed out junit tests org.apache.hadoop.mapreduce.lib.jobcontrol.TestMapReduceJobControl Subsystem Report/Notes Docker Image:yetus/hadoop:e2f6409 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12811852/MAPREDUCE-6719.001.patch JIRA Issue MAPREDUCE-6719 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux d71afc3bdec8 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 5107a96 Default Java 1.8.0_91 findbugs v3.0.0 javac https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/artifact/patchprocess/diff-compile-javac-hadoop-mapreduce-project_hadoop-mapreduce-client.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/testReport/ asflicense https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6564/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 25s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 4 new or modified test files.
          0 mvndep 0m 22s Maven dependency ordering for branch
          +1 mvninstall 6m 22s trunk passed
          +1 compile 1m 34s trunk passed
          +1 checkstyle 0m 28s trunk passed
          +1 mvnsite 1m 17s trunk passed
          +1 mvneclipse 0m 38s trunk passed
          +1 findbugs 1m 51s trunk passed
          +1 javadoc 0m 56s trunk passed
          0 mvndep 0m 7s Maven dependency ordering for patch
          +1 mvninstall 1m 9s the patch passed
          +1 compile 1m 39s the patch passed
          -1 javac 1m 39s hadoop-mapreduce-project_hadoop-mapreduce-client generated 23 new + 341 unchanged - 0 fixed = 364 total (was 341)
          +1 checkstyle 0m 26s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 0 new + 193 unchanged - 16 fixed = 193 total (was 209)
          +1 mvnsite 1m 29s the patch passed
          +1 mvneclipse 0m 38s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 xml 0m 1s The patch has no ill-formed XML file.
          +1 findbugs 2m 51s the patch passed
          +1 javadoc 0m 21s hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core generated 0 new + 2508 unchanged - 1 fixed = 2508 total (was 2509)
          +1 javadoc 0m 19s hadoop-mapreduce-client-common in the patch passed.
          +1 javadoc 0m 10s hadoop-mapreduce-client-jobclient in the patch passed.
          +1 unit 2m 7s hadoop-mapreduce-client-core in the patch passed.
          +1 unit 0m 43s hadoop-mapreduce-client-common in the patch passed.
          -1 unit 127m 4s hadoop-mapreduce-client-jobclient in the patch failed.
          +1 asflicense 0m 28s The patch does not generate ASF License warnings.
          154m 38s



          Reason Tests
          Timed out junit tests org.apache.hadoop.mapreduce.lib.jobcontrol.TestMapReduceJobControl



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:e2f6409
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12811869/MAPREDUCE-6719.002.patch
          JIRA Issue MAPREDUCE-6719
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux 0e7b91228f4c 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 5107a96
          Default Java 1.8.0_91
          findbugs v3.0.0
          javac https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6565/artifact/patchprocess/diff-compile-javac-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
          unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6565/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
          unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6565/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
          Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6565/testReport/
          modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client
          Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6565/console
          Powered by Apache Yetus 0.3.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 25s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 4 new or modified test files. 0 mvndep 0m 22s Maven dependency ordering for branch +1 mvninstall 6m 22s trunk passed +1 compile 1m 34s trunk passed +1 checkstyle 0m 28s trunk passed +1 mvnsite 1m 17s trunk passed +1 mvneclipse 0m 38s trunk passed +1 findbugs 1m 51s trunk passed +1 javadoc 0m 56s trunk passed 0 mvndep 0m 7s Maven dependency ordering for patch +1 mvninstall 1m 9s the patch passed +1 compile 1m 39s the patch passed -1 javac 1m 39s hadoop-mapreduce-project_hadoop-mapreduce-client generated 23 new + 341 unchanged - 0 fixed = 364 total (was 341) +1 checkstyle 0m 26s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 0 new + 193 unchanged - 16 fixed = 193 total (was 209) +1 mvnsite 1m 29s the patch passed +1 mvneclipse 0m 38s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 2m 51s the patch passed +1 javadoc 0m 21s hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core generated 0 new + 2508 unchanged - 1 fixed = 2508 total (was 2509) +1 javadoc 0m 19s hadoop-mapreduce-client-common in the patch passed. +1 javadoc 0m 10s hadoop-mapreduce-client-jobclient in the patch passed. +1 unit 2m 7s hadoop-mapreduce-client-core in the patch passed. +1 unit 0m 43s hadoop-mapreduce-client-common in the patch passed. -1 unit 127m 4s hadoop-mapreduce-client-jobclient in the patch failed. +1 asflicense 0m 28s The patch does not generate ASF License warnings. 154m 38s Reason Tests Timed out junit tests org.apache.hadoop.mapreduce.lib.jobcontrol.TestMapReduceJobControl Subsystem Report/Notes Docker Image:yetus/hadoop:e2f6409 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12811869/MAPREDUCE-6719.002.patch JIRA Issue MAPREDUCE-6719 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 0e7b91228f4c 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 5107a96 Default Java 1.8.0_91 findbugs v3.0.0 javac https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6565/artifact/patchprocess/diff-compile-javac-hadoop-mapreduce-project_hadoop-mapreduce-client.txt unit https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6565/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt unit test logs https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6565/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6565/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6565/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
          Hide
          sjlee0 Sangjin Lee added a comment - - edited

          The latest patch looks good to me. The unit test that timed out is known to happen occasionally (can't locate an open JIRA for that one though). The deprecation warning is also an unfortunate result of DistributedCache being deprecated.

          I do have a small quibble with the title of the JIRA. The title may give you an impression that with this JIRA one could use a wildcard in specifying the libjars argument. But that's not the case. What this JIRA does (in conjunction with YARN-4958) is to collapse the libjar directory in the configuration as well as the container launch context. But the current title can be confused with HADOOP-12747 ("support wildcard in libjars argument"). Can we modify the title to better describe this JIRA?

          Show
          sjlee0 Sangjin Lee added a comment - - edited The latest patch looks good to me. The unit test that timed out is known to happen occasionally (can't locate an open JIRA for that one though). The deprecation warning is also an unfortunate result of DistributedCache being deprecated. I do have a small quibble with the title of the JIRA. The title may give you an impression that with this JIRA one could use a wildcard in specifying the libjars argument . But that's not the case. What this JIRA does (in conjunction with YARN-4958 ) is to collapse the libjar directory in the configuration as well as the container launch context. But the current title can be confused with HADOOP-12747 ("support wildcard in libjars argument"). Can we modify the title to better describe this JIRA?
          Hide
          templedf Daniel Templeton added a comment -

          Does that title work?

          Show
          templedf Daniel Templeton added a comment - Does that title work?
          Hide
          sjlee0 Sangjin Lee added a comment -

          Thanks Daniel! Will commit it shortly.

          Show
          sjlee0 Sangjin Lee added a comment - Thanks Daniel! Will commit it shortly.
          Hide
          sjlee0 Sangjin Lee added a comment -

          Committed patch v.2 to trunk and branch-2 (2.9.0). Thanks Daniel Templeton for your contribution!

          Show
          sjlee0 Sangjin Lee added a comment - Committed patch v.2 to trunk and branch-2 (2.9.0). Thanks Daniel Templeton for your contribution!
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-trunk-Commit #9995 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9995/)
          MAPREDUCE-6719. The list of -libjars archives should be replaced with a (sjlee: rev 605b4b61364781fc99ed27035c793153a20d8f71)

          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/filecache/TestClientDistributedCacheManager.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/filecache/TestDistributedCache.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/filecache/DistributedCache.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/filecache/ClientDistributedCacheManager.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobResourceUploader.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmissionFiles.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-trunk-Commit #9995 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9995/ ) MAPREDUCE-6719 . The list of -libjars archives should be replaced with a (sjlee: rev 605b4b61364781fc99ed27035c793153a20d8f71) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/filecache/TestClientDistributedCacheManager.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/filecache/TestDistributedCache.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/filecache/DistributedCache.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/filecache/ClientDistributedCacheManager.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobResourceUploader.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmissionFiles.java

            People

            • Assignee:
              templedf Daniel Templeton
              Reporter:
              templedf Daniel Templeton
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development