Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-291

[Umbrella] Dynamic resource configuration

    Details

      Description

      The current Hadoop YARN resource management logic assumes per node resource is static during the lifetime of the NM process. Allowing run-time configuration on per node resource will give us finer granularity of resource elasticity. This allows Hadoop workloads to coexist with other workloads on the same hardware efficiently, whether or not the environment is virtualized. More background and design details can be found in attached proposal.

        Attachments

        1. YARN-291-CoreAndAdmin.patch
          46 kB
          Junping Du
        2. Elastic Resources for YARN-v0.2.pdf
          512 kB
          Junping Du
        3. YARN-291-OnlyUpdateWhenResourceChange-01-fix.patch
          6 kB
          Junping Du
        4. YARN-291-YARNClientCommandline-04.patch
          8 kB
          Junping Du
        5. YARN-291-AddClientRMProtocolToSetNodeResource-03.patch
          25 kB
          Junping Du
        6. YARN-291-JMXInterfaceOnNM-02.patch
          4 kB
          Junping Du
        7. YARN-291-core-HeartBeatAndScheduler-01.patch
          31 kB
          Junping Du
        8. YARN-291-all-v1.patch
          66 kB
          Junping Du

          Issue Links

            Activity

              People

              • Assignee:
                djp Junping Du
                Reporter:
                djp Junping Du
              • Votes:
                9 Vote for this issue
                Watchers:
                75 Start watching this issue

                Dates

                • Created:
                  Updated: