Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6304

Skip rm.transitionToActive call to RM if RM is already active.

Details

    • Reviewed

    Description

      When elector elects RM to become active, even though RM is already in ACTIVE state AdminService does refresh on following configurations.

      1. refreshAdminAcls
      2. refreshAll to update the configurations.

      But ideally even these operations are need NOT to be done and can be skipped refreshing configurations on ACTIVE RM. However admin executes refresh command separately if there is any config changes to be done.

      Attachments

        1. YARN-6304.0001.patch
          1 kB
          Rohith Sharma K S

        Issue Links

          Activity

            2.8.1 became a security release. Moving fix-version to 2.8.2 after the fact.

            vinodkv Vinod Kumar Vavilapalli added a comment - 2.8.1 became a security release. Moving fix-version to 2.8.2 after the fact.

            I have back ported to 2.7.4.

            rohithsharma Rohith Sharma K S added a comment - I have back ported to 2.7.4.
            hudson Hudson added a comment -

            SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11594 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11594/)
            YARN-6304. Skip rm.transitionToActive call to RM if RM is already (junping_du: rev 6ed9d362242d36bfae4083bf3b1c2eb32fbb2f72)

            • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/AdminService.java
            hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11594 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11594/ ) YARN-6304 . Skip rm.transitionToActive call to RM if RM is already (junping_du: rev 6ed9d362242d36bfae4083bf3b1c2eb32fbb2f72) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/AdminService.java
            junping_du Junping Du added a comment -

            I have commit the patch to trunk, branch-2, branch-2.8 and branch-2.8.1. Thanks rohithsharma for contributing the patch and kasha for review!

            junping_du Junping Du added a comment - I have commit the patch to trunk, branch-2, branch-2.8 and branch-2.8.1. Thanks rohithsharma for contributing the patch and kasha for review!
            hadoopqa Hadoop QA added a comment -
            -1 overall



            Vote Subsystem Runtime Comment
            0 reexec 0m 18s Docker mode activated.
            +1 @author 0m 0s The patch does not contain any @author tags.
            -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
            +1 mvninstall 13m 30s trunk passed
            +1 compile 0m 34s trunk passed
            +1 checkstyle 0m 26s trunk passed
            +1 mvnsite 0m 37s trunk passed
            +1 mvneclipse 0m 18s trunk passed
            +1 findbugs 1m 2s trunk passed
            +1 javadoc 0m 22s trunk passed
            +1 mvninstall 0m 40s the patch passed
            +1 compile 0m 39s the patch passed
            +1 javac 0m 39s the patch passed
            +1 checkstyle 0m 26s the patch passed
            +1 mvnsite 0m 41s the patch passed
            +1 mvneclipse 0m 18s the patch passed
            +1 whitespace 0m 0s The patch has no whitespace issues.
            +1 findbugs 1m 23s the patch passed
            +1 javadoc 0m 22s the patch passed
            +1 unit 39m 32s hadoop-yarn-server-resourcemanager in the patch passed.
            +1 asflicense 0m 16s The patch does not generate ASF License warnings.
            62m 46s



            Subsystem Report/Notes
            Docker Image:yetus/hadoop:0ac17dc
            JIRA Issue YARN-6304
            JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12856751/YARN-6304.0001.patch
            Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
            uname Linux ad2b2b707a78 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
            Build tool maven
            Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
            git revision trunk / f1de2c8
            Default Java 1.8.0_121
            findbugs v3.0.0
            Test Results https://builds.apache.org/job/PreCommit-YARN-Build/15654/testReport/
            modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
            Console output https://builds.apache.org/job/PreCommit-YARN-Build/15654/console
            Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

            This message was automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 18s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 13m 30s trunk passed +1 compile 0m 34s trunk passed +1 checkstyle 0m 26s trunk passed +1 mvnsite 0m 37s trunk passed +1 mvneclipse 0m 18s trunk passed +1 findbugs 1m 2s trunk passed +1 javadoc 0m 22s trunk passed +1 mvninstall 0m 40s the patch passed +1 compile 0m 39s the patch passed +1 javac 0m 39s the patch passed +1 checkstyle 0m 26s the patch passed +1 mvnsite 0m 41s the patch passed +1 mvneclipse 0m 18s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 23s the patch passed +1 javadoc 0m 22s the patch passed +1 unit 39m 32s hadoop-yarn-server-resourcemanager in the patch passed. +1 asflicense 0m 16s The patch does not generate ASF License warnings. 62m 46s Subsystem Report/Notes Docker Image:yetus/hadoop:0ac17dc JIRA Issue YARN-6304 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12856751/YARN-6304.0001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux ad2b2b707a78 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / f1de2c8 Default Java 1.8.0_121 findbugs v3.0.0 Test Results https://builds.apache.org/job/PreCommit-YARN-Build/15654/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/15654/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
            junping_du Junping Du added a comment -

            +1. I will commit it shortly if no one objects.

            junping_du Junping Du added a comment - +1. I will commit it shortly if no one objects.

            This seems benign to me. +1.

            kasha Karthik Kambatla added a comment - This seems benign to me. +1.
            hadoopqa Hadoop QA added a comment -
            -1 overall



            Vote Subsystem Runtime Comment
            0 reexec 0m 18s Docker mode activated.
            +1 @author 0m 0s The patch does not contain any @author tags.
            -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
            +1 mvninstall 12m 50s trunk passed
            +1 compile 0m 33s trunk passed
            +1 checkstyle 0m 25s trunk passed
            +1 mvnsite 0m 35s trunk passed
            +1 mvneclipse 0m 14s trunk passed
            +1 findbugs 1m 1s trunk passed
            +1 javadoc 0m 22s trunk passed
            +1 mvninstall 0m 32s the patch passed
            +1 compile 0m 31s the patch passed
            +1 javac 0m 31s the patch passed
            +1 checkstyle 0m 23s the patch passed
            +1 mvnsite 0m 33s the patch passed
            +1 mvneclipse 0m 12s the patch passed
            +1 whitespace 0m 0s The patch has no whitespace issues.
            +1 findbugs 1m 5s the patch passed
            +1 javadoc 0m 18s the patch passed
            -1 unit 39m 11s hadoop-yarn-server-resourcemanager in the patch failed.
            +1 asflicense 0m 19s The patch does not generate ASF License warnings.
            60m 41s



            Reason Tests
            Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart



            Subsystem Report/Notes
            Docker Image:yetus/hadoop:a9ad5d6
            JIRA Issue YARN-6304
            JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12856751/YARN-6304.0001.patch
            Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
            uname Linux 41d35b0b2d8d 3.13.0-107-generic #154-Ubuntu SMP Tue Dec 20 09:57:27 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
            Build tool maven
            Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
            git revision trunk / 28daaf0
            Default Java 1.8.0_121
            findbugs v3.0.0
            unit https://builds.apache.org/job/PreCommit-YARN-Build/15205/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
            Test Results https://builds.apache.org/job/PreCommit-YARN-Build/15205/testReport/
            modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
            Console output https://builds.apache.org/job/PreCommit-YARN-Build/15205/console
            Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

            This message was automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 18s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 12m 50s trunk passed +1 compile 0m 33s trunk passed +1 checkstyle 0m 25s trunk passed +1 mvnsite 0m 35s trunk passed +1 mvneclipse 0m 14s trunk passed +1 findbugs 1m 1s trunk passed +1 javadoc 0m 22s trunk passed +1 mvninstall 0m 32s the patch passed +1 compile 0m 31s the patch passed +1 javac 0m 31s the patch passed +1 checkstyle 0m 23s the patch passed +1 mvnsite 0m 33s the patch passed +1 mvneclipse 0m 12s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 5s the patch passed +1 javadoc 0m 18s the patch passed -1 unit 39m 11s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 19s The patch does not generate ASF License warnings. 60m 41s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Issue YARN-6304 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12856751/YARN-6304.0001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 41d35b0b2d8d 3.13.0-107-generic #154-Ubuntu SMP Tue Dec 20 09:57:27 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 28daaf0 Default Java 1.8.0_121 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-YARN-Build/15205/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/15205/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/15205/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
            rohithsharma Rohith Sharma K S added a comment - - edited

            cc :-/ kasha xgong jianhe do you see any issue in returning from AdminService?

            rohithsharma Rohith Sharma K S added a comment - - edited cc :-/ kasha xgong jianhe do you see any issue in returning from AdminService?

            People

              rohithsharma Rohith Sharma K S
              rohithsharma Rohith Sharma K S
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: