Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-397 RM Scheduler api enhancements
  3. YARN-796

Allow for (admin) labels on nodes and resource-requests

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.4.1
    • None
    • None
    • None

    Description

      It will be useful for admins to specify labels for nodes. Examples of labels are OS, processor architecture etc.

      We should expose these labels and allow applications to specify labels on resource-requests.

      Obviously we need to support admin operations on adding/removing node labels.

      Attachments

        1. LabelBasedScheduling.pdf
          217 kB
          Yuliya Feldman
        2. Node-labels-Requirements-Design-doc-V1.pdf
          189 kB
          Wangda Tan
        3. Node-labels-Requirements-Design-doc-V2.pdf
          192 kB
          Wangda Tan
        4. Non-exclusive-Node-Partition-Design.pdf
          200 kB
          Wangda Tan
        5. YARN-796.node-label.consolidate.1.patch
          445 kB
          Wangda Tan
        6. YARN-796.node-label.consolidate.10.patch
          613 kB
          Wangda Tan
        7. YARN-796.node-label.consolidate.11.patch
          621 kB
          Wangda Tan
        8. YARN-796.node-label.consolidate.12.patch
          609 kB
          Wangda Tan
        9. YARN-796.node-label.consolidate.13.patch
          626 kB
          Wangda Tan
        10. YARN-796.node-label.consolidate.14.patch
          626 kB
          Wangda Tan
        11. YARN-796.node-label.consolidate.2.patch
          475 kB
          Wangda Tan
        12. YARN-796.node-label.consolidate.3.patch
          496 kB
          Wangda Tan
        13. YARN-796.node-label.consolidate.4.patch
          506 kB
          Wangda Tan
        14. YARN-796.node-label.consolidate.5.patch
          506 kB
          Wangda Tan
        15. YARN-796.node-label.consolidate.6.patch
          519 kB
          Wangda Tan
        16. YARN-796.node-label.consolidate.7.patch
          533 kB
          Wangda Tan
        17. YARN-796.node-label.consolidate.8.patch
          547 kB
          Wangda Tan
        18. YARN-796.node-label.demo.patch.1
          342 kB
          Wangda Tan
        19. YARN-796.patch
          30 kB
          Arun Murthy
        20. YARN-796.patch4
          205 kB
          Yuliya Feldman
        21. YARN-796-Diagram.pdf
          54 kB
          Wangda Tan

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. YARN-896 Roll up for long-lived services in YARN

          • Major - Major loss of function.
          • Open
          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-3999 Dynamic host configuration system (via node side plugins)

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. YARN-2253 Label Based Scheduling

          • Major - Major loss of function.
          • Resolved
          incorporates

          Sub-task - The sub-task of the issue YARN-2493 API changes for users

          • Major - Major loss of function.
          • Closed
          is a clone of

          Task - A task that needs to be done. YARN-2492 (Clone of YARN-796) Allow for (admin) labels on nodes and resource-requests

          • Major - Major loss of function.
          • Open
          is depended upon by

          Sub-task - The sub-task of the issue SLIDER-81 Support placement of containers on labeled YARN nodes

          • Major - Major loss of function.
          • Resolved
          is related to

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-6304 Specifying node labels when submitting MR jobs

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. YARN-2253 Label Based Scheduling

          • Major - Major loss of function.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-6304 Specifying node labels when submitting MR jobs

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-2848 (FICA) Applications should maintain an application specific 'cluster' resource to calculate headroom and userlimit

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              leftnoteasy Wangda Tan
              acmurthy Arun Murthy
              Votes:
              8 Vote for this issue
              Watchers:
              101 Start watching this issue

              Dates

                Created:
                Updated: