[BIGTOP-313] Move puppet configuration out of manifest and into extlookup() CSV

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.3.0, 0.4.0
• Component/s: deployment
• Labels: deploy deployment puppet
• Assignee: Roman Shaposhnik
• Reporter: Patrick Taylor Ramsey
• Created: 20/Dec/11 01:14
• Updated: 06/Jul/14 22:11
• Resolved: 12/Jan/12 02:26

Description

Previously, bigtop-deploy puppet could only be configured by editing puppet manifests, or through a small number of environment variables that set facter facts. I've rewritten cluster.pp to use extlookup to read most configuration options from a site-specific CSV file with sane defaults for most options (only hadoop_head_node and bigtop_yumrepo_uri are required to be set). These changes should make it easier to automate deploying multiple clusters with different configurations from the same manifests.

As written, the CSV files must live in $confdir/config/, where $confdir is the puppet config directory. This means that if you are manually calling 'puppet agent' on these manifests (rather than serving them from a puppet master), you are now required to specify --confdir in addition to --modulepath.

At some point in the future, may be worth moving to hiera, as yaml is a lot prettier and more flexible than CSV. I did this using extlookup so as not to introduce external dependencies (since extlookup is now in puppet core).