[PIG-3742] Set MR runtime settings on tez runtime

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: tez-branch
• Component/s: tez
• Hadoop Flags: Reviewed
• Assignee: Rohini Palaniswamy
• Reporter: Rohini Palaniswamy
• Created: 03/Feb/14 22:20
• Updated: 21/Nov/14 05:58
• Resolved: 07/Feb/14 00:54

Description

Classify whether a vertex is a map or reduce and set java.opts (mapreduce.map.java.opts or mapreduce.reduce.java.opts), memory.mb (mapreduce.map.memory.mb or mapreduce.reduce.memory.mb) and env (mapreduce.map.env or mapreduce.reduce.env) accordingly on the vertex. A simple thing would be to assume all root vertexes to be map vertexes and intermediate or leaf vertexes to be reduce vertexes.

Issue Links

• is related to: TEZ-793 Staging directories accumulate and pollute the home directory
• is related to: PIG-3659 Memory management for each vertex