Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4900

Dynamic configuration for task slots on TT

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.1.1
    • Fix Version/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      The current Hadoop MRV1 resource management logic assumes per node slot number is static during the lifetime of the TT process. Allowing run-time configuration on per node slot will give us finer granularity of resource elasticity. This allows Hadoop workloads to coexist with other workloads on the same hardware efficiently, whether or not the environment is virtualized.
      For more background or design details of this effort, please refer proposal in HADOOP-9165.

        Attachments

        1. MAPREDUCE-4900-demo.patch
          15 kB
          Binglin Chang
        2. MAPREDUCE-4900-demo-with-JMX.patch
          16 kB
          Binglin Chang
        3. MAPREDUCE-4900-demo-with-JMX.v2.patch
          17 kB
          Binglin Chang
        4. MAPREDUCE-4944-4900.jmx.v3.patch
          31 kB
          Binglin Chang
        5. MAPREDUCE-4944-4900.jmx.v4.patch
          36 kB
          Binglin Chang

          Issue Links

            Activity

              People

              • Assignee:
                decster Binglin Chang
                Reporter:
                junping_du Junping Du
              • Votes:
                0 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated: