[WHIRR-461] Allow user to specify spot instance price per instance template group

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Assignee: Andrei Savu
• Reporter: Andrei Savu
• Created: 02/Jan/12 14:18
• Updated: 09/Oct/12 09:47
• Resolved: 05/Jan/12 18:58

Description

A natural improvement on top of WHIRR-332 is to allow the user to specify the spot instance price per instance template group.

Proposed syntax:

whirr.templates.role1+role2.aws-ec2-spot-price=0.23

Using this feature we can have a Hadoop cluster that has both regular and spot instance like this:

whirr.cluster-name=hadoop-on-ec2
whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker, 3 hadoop-datanode+hadoop-jobtracker, 7 hadoop-datanode+hadoop-jobtracker+noop

# user a large instance for the namenode as needed
whirr.templates.hadoop-namenode+hadoop-jobtracker.hardware-id=c1.xlarge

# regular smaller instance for a few data nodes
whirr.templates.hadoop-datanode+hadoop-jobtracker.hardware-id=m1.large

# and spot instances for the rest of the datanodes
whirr.templats.hadoop-datanode+hadoop-tasktracker+noop.aws-ec2-spot-price=0.32