Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Improves cumulative CPU emulation for short running tasks.
    • Tags:
      gridmix emulation cpu

      Description

      CPU emulation in Gridmix fails to meet the expected target if the map has no data to sort/spill/merge. There are 2 major reasons for this:
      1. The map task end immediately ends soon after the map task. The map progress is 67% while the map phase ends.
      2. Currently, the sort (comparator) doesnt emulate CPU. If the map is short lived, the CPU emulation thread (spawned from the map task in cleanup) doesn't get a chance to emulate.

      1. mapreduce-2591-v1.7-0.20-security.patch
        15 kB
        Amar Kamat
      2. mapreduce-2591-v1.7.patch
        15 kB
        Amar Kamat
      3. mapreduce-2591-v1.4.2.patch
        15 kB
        Amar Kamat

        Activity

          People

          • Assignee:
            Amar Kamat
            Reporter:
            Amar Kamat
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development