[SPARK-5403] Ignore UserKnownHostsFile in SSH calls

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.3.0
• Component/s: EC2
• Assignee: Grzegorz Dubicki
• Reporter: Grzegorz Dubicki
• Created: 25/Jan/15 12:56
• Updated: 06/Feb/15 23:46
• Resolved: 06/Feb/15 23:45

Description

Because of changing IPs of EC2 instances of Spark cluster event between restart of its hosts user of EC2 script may encouter problem with the script hanging on:

Waiting for all instances in cluster to enter 'ssh-ready' state..........

..as for example here: http://stackoverflow.com/questions/28002443/cluster-hangs-in-ssh-ready-state-using-spark-1-2-ec2-launch-script

Issue Links

• duplicates: SPARK-926 spark_ec2 script when ssh/scp-ing should pipe UserknowHostFile to /dev/null
• is duplicated by: SPARK-926 spark_ec2 script when ssh/scp-ing should pipe UserknowHostFile to /dev/null
• links to: [Github] Pull Request #4196 (grzegorz-dubicki)