[BIGTOP-2654] spark 2.1 binaries need either SPARK_HOME or non existing find-spark-home exe

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.2.0
• Assignee: Amir F Sanjar
• Reporter: Olaf Flebbe
• Created: 02/Jan/17 20:45
• Updated: 29/Mar/17 18:46
• Resolved: 03/Jan/17 16:36

Description

spark-shell and other executables need either the SPARK_HOME or the find-spark-home executable.

The find-spark-home is not packaged (what makes sense, since we use hardcoded /usr/lib/spark for packaging spark.

The executable does not run without either the environment variable SPARK_HOME.

I prefer not to have a puppet script to create a /etc/profile.d script to fix the situation.

I tend to patch the executables instead, to have SPARK_HOME set within the executable: (like spark-env.sh)

export SPARK_HOME=${SPARK_HOME:-/usr/lib/spark}

Comments?

Or do I miss something important (Maybe a debian specific problem?)