Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2105

Simulate Load Incrementally and Adaptively in GridMix3

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.23.0
    • Component/s: contrib/gridmix
    • Labels:
      None
    • Tags:
      gridmix emulation plugin

      Description

      Tasks launched by GridMix3 should incrementally and adaptively simulate load (I/O, CPU, memory, etc.) rather than doing
      everything upfront and then sleeping. This helps in evening out the load when fine-grained information from the original
      Task is not available and greater accuracy when it is.

      By "incremental" I mean having several iterations corresponding to appropriate phases/time-slices. By "adaptive" I mean
      taking the existing load into account before inflicting additional load to meet a target load (we are unlikely to achieve
      100% fidelity as we overshoot or undershoot with each iteration).

        Issue Links

          Activity

          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Amar Kamat made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Assignee Amar Kamat [ amar_kamat ]
          Fix Version/s 0.23.0 [ 12315570 ]
          Resolution Fixed [ 1 ]
          Tags gridmix emulation plugin
          Hide
          Amar Kamat added a comment -

          Committed as part of MAPREDUCE-2106.

          Show
          Amar Kamat added a comment - Committed as part of MAPREDUCE-2106 .
          Amar Kamat made changes -
          Field Original Value New Value
          Link This issue relates to MAPREDUCE-2115 [ MAPREDUCE-2115 ]
          Ranjit Mathew created issue -

            People

            • Assignee:
              Amar Kamat
              Reporter:
              Ranjit Mathew
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development