[SPARK-628] Make deletion of EC2 security groups optional

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.2
• Assignee: Peter Sankauskas
• Reporter: Josh Rosen
• Created: 01/Dec/12 23:07
• Updated: 12/Dec/12 13:13
• Resolved: 12/Dec/12 13:13

Description

The recent change to automatically delete EC2 security groups breaks support for custom security groups. For example, I use launch clusters using custom security groups that open ports used by the YourKit remote debugger.

I think that deletion of security groups should be optional and disabled by default to avoid surprising users with unexpected behavior or breaking existing deployments when users upgrade.