Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12344

Remove env-based configurations

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • Spark Core, YARN

    Description

      We should remove as many env-based configurations as it makes sense, since they are deprecated and we prefer to use Spark's configuration.

      Tools available through the command line should consistently support both a properties file with configuration keys and the --conf command line argument such as the one SparkSubmit supports.

      Attachments

        Issue Links

          incorporates

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-17979 Remove deprecated support for config SPARK_YARN_USER_ENV

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved

          Task - A task that needs to be done. SPARK-14453 Remove SPARK_JAVA_OPTS environment variable

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Pull request #12848 [Github] Pull Request #12848 (amits83)

          Activity

            People

              Unassigned Unassigned
              vanzin Marcelo Masiero Vanzin
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: