Description
I tried running pyspark with --py-files pythonfiles.zip but it doesn't properly add the zip file to the PYTHONPATH.
I can work around by exporting PYTHONPATH.
Looking in SparkSubmitCommandBuilder.buildPySparkShellCommand I don't see this supported at all. If that is the case perhaps it should be moved to improvement.
Note it works via spark-submit in both client and cluster mode to run python script.