Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3144

No need to set "spark.local.dir" in ExecutorLauncher

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.2
    • Fix Version/s: 1.1.0
    • Component/s: YARN
    • Labels:
      None

      Description

      ExecutorLauncher only will be lanched in Yarn-Client mode as a simple Application Master.
      In this process, it would not create the spark.local.dir since Spark driver or executor will not be launched in it.
      So it may delete such code.

        Attachments

          Activity

            People

            • Assignee:
              joshrosen Josh Rosen
              Reporter:
              carlmartin carlmartin
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: