Hadoop YARN
  1. Hadoop YARN
  2. YARN-144

MiniMRYarnCluster launches RM and JHS on default ports

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.4
    • Fix Version/s: 0.23.5
    • Component/s: None
    • Labels:
      None

      Description

      MAPREDUCE-3867, MAPREDUCE-3869, and MAPREDUCE-4406 need to be combined and applied to branch-0.23

      1. YARN-144-branch_0.23-3.patch
        33 kB
        Robert Parker
      2. YARN-144-branch_0.23-2.patch
        35 kB
        Robert Parker
      3. YARN-144-branch_0.23.patch
        41 kB
        Robert Parker

        Issue Links

          Activity

          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Build #435 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/435/)
          YARN-144. MiniMRYarnCluster launches RM and JHS on default ports. Contributed by Robert Parker (Revision 1409041)

          Result = SUCCESS
          jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409041
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JHAdminConfig.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/ipc/TestSocketFactory.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMiniMRClasspath.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
          • /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestFileArgs.java
          • /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestMultipleArchiveFiles.java
          • /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestMultipleCachefiles.java
          • /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamingTaskLog.java
          • /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestSymLink.java
          • /hadoop/common/branches/branch-0.23/hadoop-yarn-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
          • /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java
          • /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/resources/yarn-site.xml
          • /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
          • /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          • /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #435 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/435/ ) YARN-144 . MiniMRYarnCluster launches RM and JHS on default ports. Contributed by Robert Parker (Revision 1409041) Result = SUCCESS jlowe : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409041 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/jobhistory/JHAdminConfig.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/ipc/TestSocketFactory.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMiniMRClasspath.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestFileArgs.java /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestMultipleArchiveFiles.java /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestMultipleCachefiles.java /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamingTaskLog.java /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestSymLink.java /hadoop/common/branches/branch-0.23/hadoop-yarn-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/resources/yarn-site.xml /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/src/test/java/org/apache/hadoop/yarn/server/MiniYARNCluster.java
          Hide
          Jason Lowe added a comment -

          Thanks, Rob. I committed this to branch-0.23.

          Show
          Jason Lowe added a comment - Thanks, Rob. I committed this to branch-0.23.
          Hide
          Jason Lowe added a comment -

          +1, thanks for the update Rob.

          Show
          Jason Lowe added a comment - +1, thanks for the update Rob.
          Hide
          Jason Lowe added a comment -

          The change to HistoryClientService.java is still in the latest patch and appears to be reverting some of the changes introduced by MAPREDUCE-4163.

          Show
          Jason Lowe added a comment - The change to HistoryClientService.java is still in the latest patch and appears to be reverting some of the changes introduced by MAPREDUCE-4163 .
          Hide
          Robert Parker added a comment -

          Jason nice catch! AdminService, ApplicationMasterService, ClientRMService, and ResourceTrackerService did not need any changes when I compared to trunk. Removed the CHANGES.txt. Retested and all passed.

          Show
          Robert Parker added a comment - Jason nice catch! AdminService, ApplicationMasterService, ClientRMService, and ResourceTrackerService did not need any changes when I compared to trunk. Removed the CHANGES.txt. Retested and all passed.
          Hide
          Jason Lowe added a comment -

          Comments on the patch:

          • Normally CHANGES.txt does not appear in a patch. This file is modified by the committer when the patch is committed.
          • HistoryClientService.java: This change was removed on trunk by MAPREDUCE-4163, and MAPREDUCE-4163 is already in branch-0.23, so it looks like we're inadvertently reverting portions of that change. Same comment applies to these files:
            • AdminService.java
            • ApplicationMasterService.java
            • ClientRMService.java
            • ResourceTrackerService.java
          Show
          Jason Lowe added a comment - Comments on the patch: Normally CHANGES.txt does not appear in a patch. This file is modified by the committer when the patch is committed. HistoryClientService.java: This change was removed on trunk by MAPREDUCE-4163 , and MAPREDUCE-4163 is already in branch-0.23, so it looks like we're inadvertently reverting portions of that change. Same comment applies to these files: AdminService.java ApplicationMasterService.java ClientRMService.java ResourceTrackerService.java
          Hide
          Robert Parker added a comment -

          Verified that all affected unit tests completed correctly.

          Show
          Robert Parker added a comment - Verified that all affected unit tests completed correctly.
          Hide
          Robert Parker added a comment -

          Applied MAPREDUCE-3867, MAPREDUCE-3869, and MAPREDUCE-4406 with minor changes for the move to the hadoop-yarn directories

          Show
          Robert Parker added a comment - Applied MAPREDUCE-3867 , MAPREDUCE-3869 , and MAPREDUCE-4406 with minor changes for the move to the hadoop-yarn directories

            People

            • Assignee:
              Robert Parker
              Reporter:
              Robert Parker
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development