[SPARK-3213] spark_ec2.py cannot find slave instances launched with "Launch More Like This"

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.1.0
• Component/s: EC2
• Target Version/s: 1.1.0
• Assignee: Unassigned
• Reporter: Joseph K. Bradley
• Created: 25/Aug/14 20:48
• Updated: 25/Apr/15 04:10
• Resolved: 27/Aug/14 21:26

Description

spark_ec2.py cannot find all slave instances. In particular:

• I created a master & slave and configured them.
• I created new slave instances from the original slave ("Launch More Like This").
• I tried to relaunch the cluster, and it could only find the original slave.

Old versions of the script worked. The latest working commit which edited that .py script is: a0bcbc159e89be868ccc96175dbf1439461557e1

There may be a problem with this PR: https://github.com/apache/spark/pull/1899.

Issue Links

• is related to: SPARK-2008 Enhance spark-ec2 to be able to add and remove slaves to an existing cluster