[SPARK-8576] Add spark-ec2 options to assign launched instances into IAM roles and to set instance-initiated shutdown behavior

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: EC2
• Target Version/s: 1.5.0
• Assignee: Nicholas Chammas
• Reporter: Nicholas Chammas
• Created: 23/Jun/15 21:29
• Updated: 24/Jun/15 18:21
• Resolved: 24/Jun/15 18:21

Description

There are 2 EC2 options that would be useful to add.

• One is the ability to assign IAM roles to launched instances.
• The other is the ability to configure instances to self-terminate when they initiate a shutdown.

Both of these options are useful when spark-ec2 is being used as part of an automated pipeline and the engineers want to minimize the need to pass around AWS keys for access (replaced by IAM role) and to be able to launch a cluster that can terminate itself cleanly.

Issue Links

• relates to: SPARK-6220 Allow extended EC2 options to be passed through spark-ec2
• links to: [Github] Pull Request #6962 (nchammas)