Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7628

[Documentation] Documenting the ability to disable elasticity at leaf queue

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • capacity scheduler
    • None
    • Reviewed

    Description

      Update documentation after YARN-7274 gets in.

      Attachments

        1. YARN-7628.wip.1.patch
          3 kB
          Zian Chen
        2. YARN-7628.2.patch
          3 kB
          Zian Chen

        Activity

          leftnoteasy Wangda Tan added a comment -

          Converted to issue.

          leftnoteasy Wangda Tan added a comment - Converted to issue.
          Zian Chen Zian Chen added a comment -

          Attached patch (WIP). leftnoteasy, any suggestions would be appreciated!

          Zian Chen Zian Chen added a comment - Attached patch (WIP). leftnoteasy , any suggestions would be appreciated!
          leftnoteasy Wangda Tan added a comment -

          Thanks Zian Chen, you don't have to mark it to be WIP unless it is not a finished feature (without tests, cannot compile, not functional, etc.).

          I suggest to keep it simple. Just remove Defaults to -1 which disables it. from the original doc, and states that
          1) Value is between 0 and 100.
          2) Admin needs to make sure absolute maximum capacity >= absolute capacity for each queue.

          And also, what's the behavior of specifying "-1" to maximum capacity? We should document that as well.

          leftnoteasy Wangda Tan added a comment - Thanks Zian Chen , you don't have to mark it to be WIP unless it is not a finished feature (without tests, cannot compile, not functional, etc.). I suggest to keep it simple. Just remove Defaults to -1 which disables it. from the original doc, and states that 1) Value is between 0 and 100. 2) Admin needs to make sure absolute maximum capacity >= absolute capacity for each queue. And also, what's the behavior of specifying "-1" to maximum capacity? We should document that as well.
          genericqa genericqa added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 30s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
                trunk Compile Tests
          +1 mvninstall 14m 40s trunk passed
          +1 mvnsite 0m 18s trunk passed
          +1 shadedclient 23m 34s branch has no errors when building and testing our client artifacts.
                Patch Compile Tests
          +1 mvnsite 0m 18s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 shadedclient 9m 51s patch has no errors when building and testing our client artifacts.
                Other Tests
          +1 asflicense 0m 21s The patch does not generate ASF License warnings.
          34m 55s



          Subsystem Report/Notes
          Docker Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:5b98639
          JIRA Issue YARN-7628
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12901327/YARN-7628.wip.1.patch
          Optional Tests asflicense mvnsite
          uname Linux 77394ac7621e 4.4.0-64-generic #85-Ubuntu SMP Mon Feb 20 11:50:30 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/patchprocess/precommit/personality/provided.sh
          git revision trunk / 670e8d4
          maven version: Apache Maven 3.3.9
          Max. process+thread count 440 (vs. ulimit of 5000)
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/18850/console
          Powered by Apache Yetus 0.7.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          genericqa genericqa added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 30s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags.       trunk Compile Tests +1 mvninstall 14m 40s trunk passed +1 mvnsite 0m 18s trunk passed +1 shadedclient 23m 34s branch has no errors when building and testing our client artifacts.       Patch Compile Tests +1 mvnsite 0m 18s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 shadedclient 9m 51s patch has no errors when building and testing our client artifacts.       Other Tests +1 asflicense 0m 21s The patch does not generate ASF License warnings. 34m 55s Subsystem Report/Notes Docker Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:5b98639 JIRA Issue YARN-7628 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12901327/YARN-7628.wip.1.patch Optional Tests asflicense mvnsite uname Linux 77394ac7621e 4.4.0-64-generic #85-Ubuntu SMP Mon Feb 20 11:50:30 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/patchprocess/precommit/personality/provided.sh git revision trunk / 670e8d4 maven version: Apache Maven 3.3.9 Max. process+thread count 440 (vs. ulimit of 5000) modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site Console output https://builds.apache.org/job/PreCommit-YARN-Build/18850/console Powered by Apache Yetus 0.7.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Zian Chen Zian Chen added a comment -

          leftnoteasy, thank you so much for your comments. I just update the patch according to your suggestions, is this looks good?

          Zian Chen Zian Chen added a comment - leftnoteasy , thank you so much for your comments. I just update the patch according to your suggestions, is this looks good?
          genericqa genericqa added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 14s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
                trunk Compile Tests
          +1 mvninstall 16m 24s trunk passed
          +1 mvnsite 0m 18s trunk passed
          +1 shadedclient 26m 34s branch has no errors when building and testing our client artifacts.
                Patch Compile Tests
          +1 mvnsite 0m 14s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 shadedclient 11m 7s patch has no errors when building and testing our client artifacts.
                Other Tests
          +1 asflicense 0m 20s The patch does not generate ASF License warnings.
          38m 53s



          Subsystem Report/Notes
          Docker Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:5b98639
          JIRA Issue YARN-7628
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12901985/YARN-7628.2.patch
          Optional Tests asflicense mvnsite
          uname Linux 1e413e833755 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11 12:48:20 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/patchprocess/precommit/personality/provided.sh
          git revision trunk / 438c1d3
          maven version: Apache Maven 3.3.9
          Max. process+thread count 341 (vs. ulimit of 5000)
          modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/18917/console
          Powered by Apache Yetus 0.7.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          genericqa genericqa added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 14s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags.       trunk Compile Tests +1 mvninstall 16m 24s trunk passed +1 mvnsite 0m 18s trunk passed +1 shadedclient 26m 34s branch has no errors when building and testing our client artifacts.       Patch Compile Tests +1 mvnsite 0m 14s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 shadedclient 11m 7s patch has no errors when building and testing our client artifacts.       Other Tests +1 asflicense 0m 20s The patch does not generate ASF License warnings. 38m 53s Subsystem Report/Notes Docker Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:5b98639 JIRA Issue YARN-7628 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12901985/YARN-7628.2.patch Optional Tests asflicense mvnsite uname Linux 1e413e833755 3.13.0-129-generic #178-Ubuntu SMP Fri Aug 11 12:48:20 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/patchprocess/precommit/personality/provided.sh git revision trunk / 438c1d3 maven version: Apache Maven 3.3.9 Max. process+thread count 341 (vs. ulimit of 5000) modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site Console output https://builds.apache.org/job/PreCommit-YARN-Build/18917/console Powered by Apache Yetus 0.7.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Zian Chen Zian Chen added a comment -

          leftnoteasy Hi Wangda, can you help commit this documentation patch since YARN-7274 is resolved? Thanks!

          Zian Chen Zian Chen added a comment - leftnoteasy Hi Wangda, can you help commit this documentation patch since YARN-7274 is resolved? Thanks!
          leftnoteasy Wangda Tan added a comment -

          Looks good, +1. WIll commit this patch.

          leftnoteasy Wangda Tan added a comment - Looks good, +1. WIll commit this patch.
          leftnoteasy Wangda Tan added a comment -

          Thanks Zian Chen for working on this issue. Committed to trunk!

          leftnoteasy Wangda Tan added a comment - Thanks Zian Chen for working on this issue. Committed to trunk!
          hudson Hudson added a comment -

          SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13553 (See https://builds.apache.org/job/Hadoop-trunk-Commit/13553/)
          YARN-7628. [Documentation] Documenting the ability to disable elasticity (wangda: rev 051ad9d63f41ae98be728a7cdbdad9b072316318)

          • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
          hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13553 (See https://builds.apache.org/job/Hadoop-trunk-Commit/13553/ ) YARN-7628 . [Documentation] Documenting the ability to disable elasticity (wangda: rev 051ad9d63f41ae98be728a7cdbdad9b072316318) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md

          People

            Zian Chen Zian Chen
            Zian Chen Zian Chen
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: