Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Not A Problem
-
1.6.0, 2.0.0, 2.1.0
-
None
-
None
Description
On starting a spark-shell or pyshark shell if we pass --conf spark.app.name=test it is not working as --name "Spark shell" takes precedence over --conf
line refrence for spark-shell
https://github.com/apache/spark/blob/master/bin/spark-shell#L53
similarly line refrence for pyspark
https://github.com/apache/spark/blob/master/bin/pyspark#L77