Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20595

Parse the 'SPARK_EXECUTOR_INSTANCES' into the parsed arguments

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 2.1.0
    • None
    • Deploy
    • None

    Description

      Currently, when we set the parameter `SPARK_EXECUTOR_INSTANCES` in the `spark-env.sh`, it seems that the parameter doesn't parsed by Spark. So this patch parse the 'SPARK_EXECUTOR_INSTANCES' into the parsed arguments.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-17979 Remove deprecated support for config SPARK_YARN_USER_ENV

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved
          links to

          Pull request #17859 [Github] Pull Request #17859 (ConeyLiu)

          Activity

            People

              Unassigned Unassigned
              coneyliu Xianyang Liu
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: