[HIVE-11518] Provide interface to adjust required resource for tez tasks

• Type: Improvement
• Status: Patch Available
• Priority: Minor
• Resolution: Unresolved
• Component/s: Query Processor
• Assignee: Navis Ryu
• Reporter: Navis Ryu
• Created: 11/Aug/15 07:13
• Updated: 13/Oct/15 19:14

Description

Resource requirements for each tasks are varied but currently it's fixed to one value(via hive.tez.container.size). It would be good to customize resource requirements appropriate to expected work.

Suggested interface is quite simple.

public interface ResourceCalculator {

  Resource adjust(Resource resource, MapWork mapWork);

  Resource adjust(Resource resource, ReduceWork reduceWork);
}

Issue Links

• links to: review board