[SPARK-5527] Improvements to standalone doc. - how to sync cluster conf file

• Type: Documentation
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 1.2.0, 1.3.0
• Component/s: Documentation
• Labels: docuentation starter
• Assignee: Unassigned
• Reporter: Dongxu
• Created: 02/Feb/15 09:59
• Updated: 09/Feb/15 23:30
• Resolved: 09/Feb/15 23:30

Description

We must make all node conf file consistent when we start our standalone cluster. For example, we set "SPARK_WORKER_INSTANCES=2" to start 2 worker on each machine.
I see this code at $SPARK_HOME/sbin/spark-daemon.sh

if [ "$SPARK_MASTER" != "" ]; then
echo rsync from $SPARK_MASTER
rsync -a -e ssh --delete --exclude=.svn --exclude='logs/' --exclude='contrib/hod/logs/' $SPARK_MASTER/ "$SPARK_HOME"
fi

I think we better mention it at document .

Issue Links

• links to: [Github] Pull Request #4310 (lazyman500)