Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
0.9.2, 1.0.0, 1.0.1
Description
For example;-
In PySpark, if we try to initialize spark context with insufficient arguments, >>>sc=SparkContext('local')
it fails with an exception
Exception: An application name must be set in your configuration
This is all fine.
However, any successive creation of spark context with correct arguments, also fails,
>>>s1=SparkContext('local', 'test1')
AttributeError: 'SparkContext' object has no attribute 'master'