[OOZIE-2569] Adding yarn-site, core-site, hdfs-site and mapred-site into spark launcher

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.3.0
• Component/s: core
• Assignee: Abhishek Bafna
• Reporter: Abhishek Bafna
• Created: 13/Jun/16 08:45
• Updated: 02/Dec/16 21:01
• Resolved: 19/Sep/16 17:08

Description

Oozie Spark action requires yarn-site, core-site, hdfs-site and mapred-site to be present in the classpath for launching the spark applications. Currently we manually copy these files into oozie spark sharelib.

Until it is fixed through the spark, we can copy the oozie.action.conf.xml file as yarn-site, core-site, hdfs-site and mapred-site, which will avoid manual steps of copying those files.

Issue Links

• is related to: OOZIE-2343 Shell Action should take Oozie Action config and setup HADOOP_CONF_DIR
• links to: Review Board Link