Uploaded image for project: 'Apache Whirr (retired)'
  1. Apache Whirr (retired)
  2. WHIRR-461

Allow user to specify spot instance price per instance template group

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None

      Description

      A natural improvement on top of WHIRR-332 is to allow the user to specify the spot instance price per instance template group.

      Proposed syntax:

      whirr.templates.role1+role2.aws-ec2-spot-price=0.23
      

      Using this feature we can have a Hadoop cluster that has both regular and spot instance like this:

      whirr.cluster-name=hadoop-on-ec2
      whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker, 3 hadoop-datanode+hadoop-jobtracker, 7 hadoop-datanode+hadoop-jobtracker+noop
      
      # user a large instance for the namenode as needed
      whirr.templates.hadoop-namenode+hadoop-jobtracker.hardware-id=c1.xlarge
      
      # regular smaller instance for a few data nodes
      whirr.templates.hadoop-datanode+hadoop-jobtracker.hardware-id=m1.large
      
      # and spot instances for the rest of the datanodes
      whirr.templats.hadoop-datanode+hadoop-tasktracker+noop.aws-ec2-spot-price=0.32
      
      

        Attachments

          Activity

            People

            • Assignee:
              savu.andrei Andrei Savu
              Reporter:
              savu.andrei Andrei Savu
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: