[WHIRR-332] Need to specify different instance size/type depending on role

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.5.0
• Fix Version/s: 0.8.0
• Component/s: service/hadoop
• Assignee: Andrei Savu
• Reporter: Paul Baclace
• Created: 18/Jun/11 21:58
• Updated: 09/Oct/12 09:47
• Resolved: 02/Jan/12 13:58

Description

When setting up Hadoop, whirr.hardware-id is used in the configuration to set a single instance size/type for both nn,jt and dn,tt roles, but there are workloads that benefit from having a different instance size/type for each role. This need is even greater for ensembles with Zookeeper and HBase.

Without this, a small Whirr cluster underutilizes resources.

whirr.hardware-id should be a used to set a default instance size/type, and variations like whirr.${role}.hardware-id could be used to set size/type more specifically. This is a simple, obvious, and easy to implement mechanism to provide this functionality.

Issue Links

• is part of: WHIRR-318 More extensible cluster spec file format
• requires: WHIRR-458 Remove deprecated code and aliasing mechanism