Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6404

Allow AM to specify a port range for starting its webapp

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha4
    • Component/s: applicationmaster
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Add a new configuration - "yarn.app.mapreduce.am.webapp.port-range" to specify port-range for webapp launched by AM.

      Description

      Allow AM to specify a port range for starting its webapp

      1. MAPREDUCE-6404.01.patch
        3 kB
        Varun Saxena
      2. MAPREDUCE-6404.02.patch
        3 kB
        Varun Saxena

        Issue Links

          Activity

          Hide
          djp Junping Du added a comment -

          HADOOP-12097 already get commit in. Submit the patch for this JIRA.

          Show
          djp Junping Du added a comment - HADOOP-12097 already get commit in. Submit the patch for this JIRA.
          Hide
          Naganarasimha Naganarasimha G R added a comment -

          Have triggered the build manually !

          Show
          Naganarasimha Naganarasimha G R added a comment - Have triggered the build manually !
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 28s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          0 mvndep 0m 52s Maven dependency ordering for branch
          +1 mvninstall 13m 49s trunk passed
          +1 compile 1m 42s trunk passed
          +1 checkstyle 0m 33s trunk passed
          +1 mvnsite 0m 50s trunk passed
          +1 mvneclipse 0m 28s trunk passed
          +1 findbugs 1m 27s trunk passed
          +1 javadoc 0m 35s trunk passed
          0 mvndep 0m 7s Maven dependency ordering for patch
          +1 mvninstall 0m 42s the patch passed
          +1 compile 1m 32s the patch passed
          +1 javac 1m 32s the patch passed
          -1 checkstyle 0m 30s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 2 new + 540 unchanged - 0 fixed = 542 total (was 540)
          +1 mvnsite 0m 45s the patch passed
          +1 mvneclipse 0m 23s the patch passed
          -1 whitespace 0m 0s The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 xml 0m 1s The patch has no ill-formed XML file.
          +1 findbugs 1m 32s the patch passed
          +1 javadoc 0m 30s the patch passed
          +1 unit 2m 50s hadoop-mapreduce-client-core in the patch passed.
          +1 unit 9m 21s hadoop-mapreduce-client-app in the patch passed.
          +1 asflicense 0m 22s The patch does not generate ASF License warnings.
          40m 15s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:a9ad5d6
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12781569/MAPREDUCE-6404.01.patch
          JIRA Issue MAPREDUCE-6404
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux 9f40be2773e3 3.13.0-103-generic #150-Ubuntu SMP Thu Nov 24 10:34:17 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / cce35c3
          Default Java 1.8.0_121
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6888/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
          whitespace https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6888/artifact/patchprocess/whitespace-eol.txt
          Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6888/testReport/
          modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app U: hadoop-mapreduce-project/hadoop-mapreduce-client
          Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6888/console
          Powered by Apache Yetus 0.3.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 28s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 0m 52s Maven dependency ordering for branch +1 mvninstall 13m 49s trunk passed +1 compile 1m 42s trunk passed +1 checkstyle 0m 33s trunk passed +1 mvnsite 0m 50s trunk passed +1 mvneclipse 0m 28s trunk passed +1 findbugs 1m 27s trunk passed +1 javadoc 0m 35s trunk passed 0 mvndep 0m 7s Maven dependency ordering for patch +1 mvninstall 0m 42s the patch passed +1 compile 1m 32s the patch passed +1 javac 1m 32s the patch passed -1 checkstyle 0m 30s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 2 new + 540 unchanged - 0 fixed = 542 total (was 540) +1 mvnsite 0m 45s the patch passed +1 mvneclipse 0m 23s the patch passed -1 whitespace 0m 0s The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 1m 32s the patch passed +1 javadoc 0m 30s the patch passed +1 unit 2m 50s hadoop-mapreduce-client-core in the patch passed. +1 unit 9m 21s hadoop-mapreduce-client-app in the patch passed. +1 asflicense 0m 22s The patch does not generate ASF License warnings. 40m 15s Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12781569/MAPREDUCE-6404.01.patch JIRA Issue MAPREDUCE-6404 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 9f40be2773e3 3.13.0-103-generic #150-Ubuntu SMP Thu Nov 24 10:34:17 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / cce35c3 Default Java 1.8.0_121 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6888/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt whitespace https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6888/artifact/patchprocess/whitespace-eol.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6888/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6888/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 25s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          0 mvndep 0m 59s Maven dependency ordering for branch
          +1 mvninstall 13m 48s trunk passed
          +1 compile 1m 43s trunk passed
          +1 checkstyle 0m 35s trunk passed
          +1 mvnsite 0m 52s trunk passed
          +1 mvneclipse 0m 30s trunk passed
          +1 findbugs 1m 41s trunk passed
          +1 javadoc 0m 40s trunk passed
          0 mvndep 0m 7s Maven dependency ordering for patch
          +1 mvninstall 0m 45s the patch passed
          +1 compile 1m 37s the patch passed
          +1 javac 1m 37s the patch passed
          -1 checkstyle 0m 31s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 2 new + 540 unchanged - 0 fixed = 542 total (was 540)
          +1 mvnsite 0m 48s the patch passed
          +1 mvneclipse 0m 24s the patch passed
          -1 whitespace 0m 0s The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 xml 0m 1s The patch has no ill-formed XML file.
          +1 findbugs 1m 38s the patch passed
          +1 javadoc 0m 33s the patch passed
          +1 unit 2m 52s hadoop-mapreduce-client-core in the patch passed.
          +1 unit 9m 20s hadoop-mapreduce-client-app in the patch passed.
          +1 asflicense 0m 20s The patch does not generate ASF License warnings.
          41m 6s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:a9ad5d6
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12781569/MAPREDUCE-6404.01.patch
          JIRA Issue MAPREDUCE-6404
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux ece2bf37022b 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / cce35c3
          Default Java 1.8.0_121
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6889/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt
          whitespace https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6889/artifact/patchprocess/whitespace-eol.txt
          Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6889/testReport/
          modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app U: hadoop-mapreduce-project/hadoop-mapreduce-client
          Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6889/console
          Powered by Apache Yetus 0.3.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 25s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 0m 59s Maven dependency ordering for branch +1 mvninstall 13m 48s trunk passed +1 compile 1m 43s trunk passed +1 checkstyle 0m 35s trunk passed +1 mvnsite 0m 52s trunk passed +1 mvneclipse 0m 30s trunk passed +1 findbugs 1m 41s trunk passed +1 javadoc 0m 40s trunk passed 0 mvndep 0m 7s Maven dependency ordering for patch +1 mvninstall 0m 45s the patch passed +1 compile 1m 37s the patch passed +1 javac 1m 37s the patch passed -1 checkstyle 0m 31s hadoop-mapreduce-project/hadoop-mapreduce-client: The patch generated 2 new + 540 unchanged - 0 fixed = 542 total (was 540) +1 mvnsite 0m 48s the patch passed +1 mvneclipse 0m 24s the patch passed -1 whitespace 0m 0s The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 1m 38s the patch passed +1 javadoc 0m 33s the patch passed +1 unit 2m 52s hadoop-mapreduce-client-core in the patch passed. +1 unit 9m 20s hadoop-mapreduce-client-app in the patch passed. +1 asflicense 0m 20s The patch does not generate ASF License warnings. 41m 6s Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12781569/MAPREDUCE-6404.01.patch JIRA Issue MAPREDUCE-6404 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux ece2bf37022b 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / cce35c3 Default Java 1.8.0_121 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6889/artifact/patchprocess/diff-checkstyle-hadoop-mapreduce-project_hadoop-mapreduce-client.txt whitespace https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6889/artifact/patchprocess/whitespace-eol.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6889/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6889/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
          Hide
          djp Junping Du added a comment -

          Patch looks good - just some checkstyle, white space issues, should be easy to fix.

          Show
          djp Junping Du added a comment - Patch looks good - just some checkstyle, white space issues, should be easy to fix.
          Hide
          varun_saxena Varun Saxena added a comment -

          Sure. Will fix and update the patch shortly.

          Show
          varun_saxena Varun Saxena added a comment - Sure. Will fix and update the patch shortly.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 25s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          0 mvndep 0m 17s Maven dependency ordering for branch
          +1 mvninstall 14m 9s trunk passed
          +1 compile 1m 51s trunk passed
          +1 checkstyle 0m 35s trunk passed
          +1 mvnsite 0m 58s trunk passed
          +1 mvneclipse 0m 31s trunk passed
          +1 findbugs 1m 33s trunk passed
          +1 javadoc 0m 40s trunk passed
          0 mvndep 0m 8s Maven dependency ordering for patch
          +1 mvninstall 0m 45s the patch passed
          +1 compile 1m 50s the patch passed
          +1 javac 1m 50s the patch passed
          +1 checkstyle 0m 32s the patch passed
          +1 mvnsite 0m 53s the patch passed
          +1 mvneclipse 0m 24s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 xml 0m 2s The patch has no ill-formed XML file.
          +1 findbugs 1m 50s the patch passed
          +1 javadoc 0m 34s the patch passed
          +1 unit 2m 58s hadoop-mapreduce-client-core in the patch passed.
          +1 unit 9m 26s hadoop-mapreduce-client-app in the patch passed.
          +1 asflicense 0m 22s The patch does not generate ASF License warnings.
          41m 33s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:a9ad5d6
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12851143/MAPREDUCE-6404.02.patch
          JIRA Issue MAPREDUCE-6404
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux 0b29e3f09a0d 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / d88497d
          Default Java 1.8.0_121
          findbugs v3.0.0
          Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6892/testReport/
          modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app U: hadoop-mapreduce-project/hadoop-mapreduce-client
          Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6892/console
          Powered by Apache Yetus 0.3.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 25s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 0m 17s Maven dependency ordering for branch +1 mvninstall 14m 9s trunk passed +1 compile 1m 51s trunk passed +1 checkstyle 0m 35s trunk passed +1 mvnsite 0m 58s trunk passed +1 mvneclipse 0m 31s trunk passed +1 findbugs 1m 33s trunk passed +1 javadoc 0m 40s trunk passed 0 mvndep 0m 8s Maven dependency ordering for patch +1 mvninstall 0m 45s the patch passed +1 compile 1m 50s the patch passed +1 javac 1m 50s the patch passed +1 checkstyle 0m 32s the patch passed +1 mvnsite 0m 53s the patch passed +1 mvneclipse 0m 24s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 2s The patch has no ill-formed XML file. +1 findbugs 1m 50s the patch passed +1 javadoc 0m 34s the patch passed +1 unit 2m 58s hadoop-mapreduce-client-core in the patch passed. +1 unit 9m 26s hadoop-mapreduce-client-app in the patch passed. +1 asflicense 0m 22s The patch does not generate ASF License warnings. 41m 33s Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12851143/MAPREDUCE-6404.02.patch JIRA Issue MAPREDUCE-6404 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 0b29e3f09a0d 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / d88497d Default Java 1.8.0_121 findbugs v3.0.0 Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6892/testReport/ modules C: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app U: hadoop-mapreduce-project/hadoop-mapreduce-client Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6892/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
          Hide
          djp Junping Du added a comment -

          Thanks Varun Saxena for updating the patch which looks good to me!
          +1. Will commit it shortly.

          Show
          djp Junping Du added a comment - Thanks Varun Saxena for updating the patch which looks good to me! +1. Will commit it shortly.
          Hide
          djp Junping Du added a comment -

          I have commit the patch to trunk and branch-2. Thanks Varun Saxena for the patch and Naganarasimha G R for comments!

          Show
          djp Junping Du added a comment - I have commit the patch to trunk and branch-2. Thanks Varun Saxena for the patch and Naganarasimha G R for comments!
          Hide
          varun_saxena Varun Saxena added a comment -

          Thanks Junping Du for the review and commit.

          Show
          varun_saxena Varun Saxena added a comment - Thanks Junping Du for the review and commit.
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11216 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11216/)
          MAPREDUCE-6404. Allow AM to specify a port range for starting its (junping_du: rev 7afe5b1a3165e284ae831cd307a526763399f66d)

          • (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
          • (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/client/MRClientService.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11216 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11216/ ) MAPREDUCE-6404 . Allow AM to specify a port range for starting its (junping_du: rev 7afe5b1a3165e284ae831cd307a526763399f66d) (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/client/MRClientService.java

            People

            • Assignee:
              varun_saxena Varun Saxena
              Reporter:
              varun_saxena Varun Saxena
            • Votes:
              1 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development