[PIG-4555] Add -XX:+UseNUMA for Tez jobs

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 0.18.0
• Assignee: Rohini Palaniswamy
• Reporter: Rohini Palaniswamy
• Created: 15/May/15 22:06
• Updated: 24/May/17 23:03

Description

For very big Tez jobs (~50K tasks), AM quickly goes OOM without -XX:+UseNUMA. tez.am.launch.cmd-opts default setting has that, but since pig gives preference to yarn.app.mapreduce.am.command-opts if present (which usually it is), -XX:+UseNUMA is not there. Need to add -XX:+UseNUMA if we are picking up mapreduce setting.