[MAPREDUCE-3008] [Gridmix] Improve cumulative CPU usage emulation for short running tasks

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha
• Fix Version/s: 1.1.0
• Component/s: contrib/gridmix
• Labels: cpu-emulation gridmix
• Hadoop Flags: Reviewed
• Release Note: Improves cumulative CPU emulation for short running tasks.
• Tags: gridmix emulation cpu
• Assignee: Amar Kamat
• Reporter: Amar Kamat
• Created: 14/Sep/11 13:08
• Updated: 10/Mar/15 04:31
• Resolved: 07/Oct/11 05:01

Description

CPU emulation in Gridmix fails to meet the expected target if the map has no data to sort/spill/merge. There are 2 major reasons for this:
1. The map task end immediately ends soon after the map task. The map progress is 67% while the map phase ends.
2. Currently, the sort (comparator) doesnt emulate CPU. If the map is short lived, the CPU emulation thread (spawned from the map task in cleanup) doesn't get a chance to emulate.