Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-291

[Umbrella] Dynamic resource configuration

    XMLWordPrintableJSON

Details

    Description

      The current Hadoop YARN resource management logic assumes per node resource is static during the lifetime of the NM process. Allowing run-time configuration on per node resource will give us finer granularity of resource elasticity. This allows Hadoop workloads to coexist with other workloads on the same hardware efficiently, whether or not the environment is virtualized. More background and design details can be found in attached proposal.

      Attachments

        1. YARN-291-all-v1.patch
          66 kB
          Junping Du
        2. YARN-291-core-HeartBeatAndScheduler-01.patch
          31 kB
          Junping Du
        3. YARN-291-JMXInterfaceOnNM-02.patch
          4 kB
          Junping Du
        4. YARN-291-AddClientRMProtocolToSetNodeResource-03.patch
          25 kB
          Junping Du
        5. YARN-291-YARNClientCommandline-04.patch
          8 kB
          Junping Du
        6. YARN-291-OnlyUpdateWhenResourceChange-01-fix.patch
          6 kB
          Junping Du
        7. Elastic Resources for YARN-v0.2.pdf
          512 kB
          Junping Du
        8. YARN-291-CoreAndAdmin.patch
          46 kB
          Junping Du

        Issue Links

          Activity

            People

              junping_du Junping Du
              junping_du Junping Du
              Votes:
              10 Vote for this issue
              Watchers:
              79 Start watching this issue

              Dates

                Created:
                Updated: