Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5139 [Umbrella] Move YARN scheduler towards global scheduler
  3. YARN-7494

Add multi-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.2.0
    • capacity scheduler
    • None
    • Reviewed

    Description

      Instead of single node, for effectiveness we can consider a multi node lookup based on partition to start with.

      Attachments

        1. YARN-7494.v0.patch
          50 kB
          Sunil G
        2. YARN-7494.v1.patch
          55 kB
          Sunil G
        3. YARN-7494.001.patch
          25 kB
          Sunil G
        4. YARN-7494.002.patch
          48 kB
          Sunil G
        5. multi-node-designProposal.png
          109 kB
          Sunil G
        6. YARN-7494.003.patch
          98 kB
          Sunil G
        7. YARN-7494.004.patch
          98 kB
          Sunil G
        8. YARN-7494.005.patch
          57 kB
          Sunil G
        9. YARN-7494.006.patch
          60 kB
          Sunil G
        10. YARN-7494.007.patch
          61 kB
          Sunil G
        11. YARN-7494.008.patch
          96 kB
          Sunil G
        12. YARN-7494.009.patch
          121 kB
          Sunil G
        13. YARN-7494.010.patch
          105 kB
          Sunil G
        14. YARN-7494.11.patch
          105 kB
          Sunil G
        15. YARN-7494.12.patch
          104 kB
          Sunil G
        16. YARN-7494.13.patch
          103 kB
          Sunil G
        17. YARN-7494.14.patch
          100 kB
          Sunil G
        18. YARN-7494.15.patch
          101 kB
          Sunil G
        19. YARN-7494.16.patch
          100 kB
          Sunil G
        20. YARN-7494.17.patch
          100 kB
          Sunil G
        21. YARN-7494.18.patch
          102 kB
          Sunil G
        22. YARN-7494.19.patch
          101 kB
          Sunil G
        23. YARN-7494.20.patch
          102 kB
          Sunil G

        Issue Links

          is blocked by

          Sub-task - The sub-task of the issue YARN-7666 Introduce scheduler specific environment variable support in ApplicationSubmissionContext for better scheduling placement configurations

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              sunilg Sunil G
              sunilg Sunil G
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: