[TEZ-1127] Add TEZ_TASK_JAVA_OPTS and TEZ_ENV configs to specify values from config

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.5.0
• Hadoop Flags: Incompatible change, Reviewed
• Assignee: Bikas Saha
• Reporter: Pala M Muthaia
• Created: 17/May/14 01:20
• Updated: 06/Sep/14 01:35
• Resolved: 26/Jun/14 02:16

Description

There is no global setting available to specify JVM parameters for tez tasks (e.g: specifying native library location with java.library.path). Yarn allows specifying application.classpath, but not java opts. The only option right now is to set mapreduce.map.java.opts in the tez job config (or hive.tez.java.opts for Hive on Tez).

Suggestion from Bikas, while discussing this in tez-user group, is tez should have "TEZ_TASK_JAVA_OPTS so that you don’t have to specify this via mapreduce configuration parameters"