Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7402 Federation V2: Global Optimizations
  3. YARN-7403

[GQ] Compute global and local "IdealAllocation"

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: federation
    • Labels:
      None

      Description

      This JIRA tracks algorithmic effort to combine the local queue views of capacity guarantee/use/demand and compute the global ideal allocation, and the respective local allocations. This will inform the RMs in each sub-clusters on how to allocate more containers to each queues (allowing for temporary over/under allocations that are locally excessive, but globally correct).

        Attachments

        1. YARN-7403.v3.patch
          77 kB
          Carlo Curino
        2. YARN-7403.v2.patch
          125 kB
          Carlo Curino
        3. YARN-7403.v1.patch
          124 kB
          Carlo Curino
        4. YARN-7403.draft3.patch
          108 kB
          Carlo Curino
        5. YARN-7403.draft2.patch
          73 kB
          Carlo Curino
        6. YARN-7403.draft.patch
          68 kB
          Carlo Curino
        7. global-queues-preemption.PNG
          90 kB
          Carlo Curino

          Issue Links

            Activity

              People

              • Assignee:
                curino Carlo Curino
                Reporter:
                curino Carlo Curino
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: