Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
The "right" way to create a SparkContext is to pass a list of JARs and a sparkHome to the constructor, but our examples still use the older 2-parameter constructor that doesn't take these parameters, and rely on the spark.examples code being present on every worker node's classpath. For some reason a commit fixing this was in branch 0.5 but never made it into 0.6 and master.
Attachments
Issue Links
- is duplicated by
-
SPARK-612 Update examples to pass JAR file to SparkContext in master and 0.6 branches
- Resolved