Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7402 Federation V2: Global Optimizations
  3. YARN-7403

[GQ] Compute global and local "IdealAllocation"

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • federation
    • None

    Description

      This JIRA tracks algorithmic effort to combine the local queue views of capacity guarantee/use/demand and compute the global ideal allocation, and the respective local allocations. This will inform the RMs in each sub-clusters on how to allocate more containers to each queues (allowing for temporary over/under allocations that are locally excessive, but globally correct).

      Attachments

        1. global-queues-preemption.PNG
          90 kB
          Carlo Curino
        2. YARN-7403.draft.patch
          68 kB
          Carlo Curino
        3. YARN-7403.draft2.patch
          73 kB
          Carlo Curino
        4. YARN-7403.draft3.patch
          108 kB
          Carlo Curino
        5. YARN-7403.v1.patch
          124 kB
          Carlo Curino
        6. YARN-7403.v2.patch
          125 kB
          Carlo Curino
        7. YARN-7403.v3.patch
          77 kB
          Carlo Curino

        Issue Links

          is blocked by

          Sub-task - The sub-task of the issue YARN-7934 [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-7953 [GQ] Data structures for federation global queues calculations

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              curino Carlo Curino
              curino Carlo Curino
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: