Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-32020

Refactor the logic to compute SPARK_HOME into a common place.

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.1
    • 3.0.1, 3.1.0
    • SQL
    • None

    Description

      Currently several unit tests inline the logic to compute spark home. Secondly the error that is thrown when spark home is not set prints the entire environment making it difficult to find the actual root cause which is "spark home is not set".

      1. Refactor the code to compute the spark home in a common place (SQLHelper.scala)
      2. Change the error message to make it more readable.

      Attachments

        Activity

          People

            dkbiswal Dilip Biswal
            dkbiswal Dilip Biswal
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: