Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-256

Self diagnosis spark configuration

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Configuring Spark interpreter is not easy. Especially with Yarn and Pyspark.
      There're so many different environment variables and properties user need to take care.

      It would be nice if Spark interpreter itself validate correctness of combination of environment variables and properties.

      Attachments

        Issue Links

          Activity

            People

              moon Lee Moon Soo
              moon Lee Moon Soo
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: