[AMBARI-18383] Oozie spark failed due to incomplete spark share-lib directory

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.5.0
• Assignee: Aravindan Vijayan
• Reporter: Aravindan Vijayan
• Created: 13/Sep/16 21:06
• Updated: 14/Sep/16 02:00
• Resolved: 13/Sep/16 23:22

Description

Failed exception:

"Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() 
threw exception, Missing py4j and/or pyspark zip files. Please add them to the lib folder 
or to the Spark sharelib.

org.apache.oozie.action.hadoop.OozieActionConfiguratorException: Missing py4j and/or 
pyspark zip files. Please add them to the lib folder or to the Spark sharelib."

Those two files were not present in the share lib
hrt_qa@hn0-3ad6fe:~$ hdfs dfs -ls /user/oozie/share/lib/spark/*.zip
ls: `/user/oozie/share/lib/spark/*.zip': No such file or directory

Issue Links

• links to: Review Board