Description
The spark and pyspark examples do not have a <mode> element in their workflow.xml files, probably because of the old way the spark CLI worked, in which to run spark on yarn in client mode, you would write
--master yarn-client
on the command line (https://spark.apache.org/docs/1.5.0/running-on-yarn.html). This still works, but from spark 1.6, the spark documentation (https://spark.apache.org/docs/1.6.0/running-on-yarn.html) says the way to do it is
--master yarn --mode client
.
We should update the two examples to have <mode> elements in workflow.xml and corresponding values in job.properties.