Bigtop
  1. Bigtop
  2. BIGTOP-313

Move puppet configuration out of manifest and into extlookup() CSV

    Details

      Description

      Previously, bigtop-deploy puppet could only be configured by editing puppet manifests, or through a small number of environment variables that set facter facts. I've rewritten cluster.pp to use extlookup to read most configuration options from a site-specific CSV file with sane defaults for most options (only hadoop_head_node and bigtop_yumrepo_uri are required to be set). These changes should make it easier to automate deploying multiple clusters with different configurations from the same manifests.

      As written, the CSV files must live in $confdir/config/, where $confdir is the puppet config directory. This means that if you are manually calling 'puppet agent' on these manifests (rather than serving them from a puppet master), you are now required to specify --confdir in addition to --modulepath.

      At some point in the future, may be worth moving to hiera, as yaml is a lot prettier and more flexible than CSV. I did this using extlookup so as not to introduce external dependencies (since extlookup is now in puppet core).

      1. patch.txt
        17 kB
        Patrick Taylor Ramsey

        Activity

        Hide
        Bruno Mahé added a comment -

        The copyright headers are wrong.

        Show
        Bruno Mahé added a comment - The copyright headers are wrong.
        Hide
        Patrick Taylor Ramsey added a comment -

        Took down patch.txt while I fix the license headers and a few other issues.

        Show
        Patrick Taylor Ramsey added a comment - Took down patch.txt while I fix the license headers and a few other issues.
        Hide
        Patrick Taylor Ramsey added a comment -

        Updated patch.

        Show
        Patrick Taylor Ramsey added a comment - Updated patch.
        Hide
        Roman Shaposhnik added a comment -

        Patrick, the patch looks great. It cleans up areas that have been in dire need of a clean up – thanks a million for doing this!

        +1

        Show
        Roman Shaposhnik added a comment - Patrick, the patch looks great. It cleans up areas that have been in dire need of a clean up – thanks a million for doing this! +1
        Hide
        Roman Shaposhnik added a comment -

        Committed to both trunk and hadoop-0.23 branch

        Show
        Roman Shaposhnik added a comment - Committed to both trunk and hadoop-0.23 branch

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Patrick Taylor Ramsey
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development