[SPARK-10532] Added new option to specify "user profile" of AWS credentials in spark/spark-ec2.py

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: EC2
• Assignee: teramonagi
• Reporter: teramonagi
• Created: 10/Sep/15 09:48
• Updated: 29/Oct/15 20:10
• Resolved: 29/Oct/15 20:10

Description

AWS users want to use "Named Profiles" sometimes.

• http://docs.aws.amazon.com/cli/latest/userguide/cli-chap-getting-started.html#cli-multiple-profiles

It is useful for AWS users to add new --profile option to specify which profiles we want to use to launch spark.
Current code assumes that we will use "[default]" profile to authorize AWS functionalities

Issue Links

• links to: [Github] Pull Request #8696 (teramonagi)