[SAMZA-2332] [AM isolation] YarnJob should pass new command and additional environment variables for AM deployment

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4
• Assignee: Cameron Lee
• Reporter: Cameron Lee
• Created: 27/Sep/19 22:15
• Updated: 19/Feb/20 00:39
• Resolved: 13/Dec/19 04:02

Description

When sending a request to YARN to deploy an application master, some extra environment variables need to be set so that the application master can be run in an isolated mode.

1. "APPLICATION_MASTER_ISOLATION_ENABLED": if AM isolation is enabled
2. "APPLICATION_LIB_DIR": location of application lib (e.g. "__package/lib")

Also, the scripts from the infrastructure resource should be used to launch the job coordinator.

Issue Links

• links to: GitHub Pull Request #1172