[SPARK-4696] Yarn: spark.driver.extra* variables not applied consistently to yarn client mode AM

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.1.0
• Component/s: YARN
• Assignee: Unassigned
• Reporter: Thomas Graves
• Created: 02/Dec/14 14:55
• Updated: 03/Aug/15 20:37
• Resolved: 03/Aug/15 20:37

Description

Currently the configs to set the driver options (spark.driver.extra* -> java options, classpath, library path) are not applied consistently by yarn to the yarn client mode application master. Right now the classpath is applied but the java options and library path aren't. We should make it consistent.

Note this is a result of discussions on the pull request for https://issues.apache.org/jira/browse/SPARK-4461
so this might be affected by the outcome of that.