[SPARK-22404] Provide an option to use unmanaged AM in yarn-client mode

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 3.0.0
• Component/s: Spark Core, YARN
• Assignee: Devaraj Kavali
• Reporter: Devaraj Kavali
• Created: 31/Oct/17 00:02
• Updated: 17/May/20 18:14
• Resolved: 25/Jan/19 19:54

Description

There was an issue SPARK-1200 to provide an option but was closed without fixing.

Using an unmanaged AM in yarn-client mode would allow apps to start up faster, but not requiring the container launcher AM to be launched on the cluster.

Issue Links

• relates to: SPARK-26737 Executor/Task STDERR & STDOUT log urls are not correct in Yarn deployment mode
• links to: [Github] Pull Request #19616 (devaraj-kavali)
• links to: GitHub Pull Request #19616