Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Incomplete
-
1.5.2
-
None
Description
spark.ssl.trustStore is used to specify the truststore to use for SSL. It is described somewhat at http://spark.apache.org/docs/1.5.2/configuration.html#security
What it does not specify is that, when used in yarn environments, it must be an absolute path available on all nodes.
In an ideal world, it would recognize it's in yarn-cluster mode, put that file in the distributed cache, and then update the local conf in each driver/executor to the local path to use they're local version.
Or at the very least, the docs could be clearer that it's incompatible with yarn-cluster mode unless you give it a path that's available on all nodes.