Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-594

Update examples to pass JARs when building a SparkContext in 0.6 and master

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.7.0
    • None
    • None

    Description

      The "right" way to create a SparkContext is to pass a list of JARs and a sparkHome to the constructor, but our examples still use the older 2-parameter constructor that doesn't take these parameters, and rely on the spark.examples code being present on every worker node's classpath. For some reason a commit fixing this was in branch 0.5 but never made it into 0.6 and master.

      Attachments

        Issue Links

          Activity

            People

              matei Matei Alexandru Zaharia
              matei Matei Alexandru Zaharia
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: