[SPARK-5382] Scripts do not use SPARK_CONF_DIR where they should

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.2.0, 1.3.0
• Fix Version/s: 1.2.1, 1.3.0
• Component/s: Spark Core
• Target Version/s: 1.2.1, 1.3.0
• Assignee: Unassigned
• Reporter: Jacek Lewandowski
• Created: 23/Jan/15 10:20
• Updated: 28/Jan/15 06:16
• Resolved: 26/Jan/15 07:41

Description

spark-class:

# Load extra JAVA_OPTS from conf/java-opts, if it exists
if [ -e "$FWDIR/conf/java-opts" ] ; then
  JAVA_OPTS="$JAVA_OPTS `cat "$FWDIR"/conf/java-opts`"
fi

spark-submit:

DEFAULT_PROPERTIES_FILE="$SPARK_HOME/conf/spark-defaults.conf"

Issue Links

• is duplicated by: SPARK-4616 SPARK_CONF_DIR is not effective in spark-submit
• links to: [Github] Pull Request #4177 (jacek-lewandowski)
• links to: [Github] Pull Request #4179 (jacek-lewandowski)