[SPARK-4509] Revert EC2 tag-based cluster membership patch in branch-1.2

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.2.0
• Component/s: EC2
• Target Version/s: 1.2.0
• Assignee: Xiangrui Meng
• Reporter: Josh Rosen
• Created: 20/Nov/14 07:22
• Updated: 10/Mar/15 03:14
• Resolved: 26/Nov/14 00:08

Description

Since we haven't fixed SPARK-3332 (the issue where tags aren't a safe strategy for determining spark-ec2 cluster membership), let's revert SPARK-2333 in branch-1.2.

I'm filing a blocker JIRA for this so that we don't forget to do this before cutting a 1.2.0 release candidate. Unfortunately, the patch doesn't cleanly revert, so this may take a bit of work to do correctly.

Issue Links

• relates to: SPARK-3332 Tagging is not atomic with launching instances on EC2
• links to: [Github] Pull Request #3453 (mengxr)