Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3243

spark.driver.* system properties are outdated if --driver-* options exist

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.2
    • Fix Version/s: 1.1.0
    • Component/s: Spark Core
    • Labels:
      None
    • Target Version/s:

      Description

      If we set "spark.driver.extraClassPath" AND "--driver-class-path", then the latter correctly overrides the former. However! The value of the system property "spark.driver.extraClassPath" remains the former, which is not actually used.

      That is just an example. Of course this also affects java options, library path and memory etc.

        Attachments

          Activity

            People

            • Assignee:
              andrewor14 Andrew Or
              Reporter:
              andrewor14 Andrew Or
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: