Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Improves cumulative CPU emulation for short running tasks.
    • Tags:
      gridmix emulation cpu

      Description

      CPU emulation in Gridmix fails to meet the expected target if the map has no data to sort/spill/merge. There are 2 major reasons for this:
      1. The map task end immediately ends soon after the map task. The map progress is 67% while the map phase ends.
      2. Currently, the sort (comparator) doesnt emulate CPU. If the map is short lived, the CPU emulation thread (spawned from the map task in cleanup) doesn't get a chance to emulate.

        Attachments

        1. mapreduce-2591-v1.4.2.patch
          15 kB
          Amar Kamat
        2. mapreduce-2591-v1.7.patch
          15 kB
          Amar Kamat
        3. mapreduce-2591-v1.7-0.20-security.patch
          15 kB
          Amar Kamat

          Activity

            People

            • Assignee:
              amar_kamat Amar Kamat
              Reporter:
              amar_kamat Amar Kamat
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: