Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-2654

spark 2.1 binaries need either SPARK_HOME or non existing find-spark-home exe

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.2.0
    • Component/s: None
    • Labels:
      None

      Description

      spark-shell and other executables need either the SPARK_HOME or the find-spark-home executable.

      The find-spark-home is not packaged (what makes sense, since we use hardcoded /usr/lib/spark for packaging spark.

      The executable does not run without either the environment variable SPARK_HOME.

      I prefer not to have a puppet script to create a /etc/profile.d script to fix the situation.

      I tend to patch the executables instead, to have SPARK_HOME set within the executable: (like spark-env.sh)

      export SPARK_HOME=${SPARK_HOME:-/usr/lib/spark}
      

      Comments?

      Or do I miss something important (Maybe a debian specific problem?)

        Attachments

          Activity

            People

            • Assignee:
              asanjar Amir Sanjar
              Reporter:
              oflebbe Olaf Flebbe
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: