Bigtop
  1. Bigtop
  2. BIGTOP-95

Puppet-based deployment infrastructure needs to be added to bigtop

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.1.0
    • Fix Version/s: 0.2.0
    • Component/s: General, Tests
    • Labels:
      None

      Description

      In order to facilitate dynamic bringup/teardown of Bigtop cluster for the purposes of stack validation we need to have an infrastructure that lets us:
      1. continuously deploy Bigtop packages from Jenkis artifacts
      2. do the required amount of configuration management
      3. be able to auto-deploy Bigtop dependencies such as databases, etc.

      Puppet seems to be the preferred CM solution that fits the above uses cases rather well.

        Activity

        Hide
        Bruno Mahé added a comment -

        +1 LGTM

        Show
        Bruno Mahé added a comment - +1 LGTM
        Hide
        Roman Shaposhnik added a comment -

        Yup, all the nuts-n-bolts for making both secure and unsecure Hadoop deployments have been pushed. The only thing that's left is to tweak the code a little bit to be be 100% compatible with how Bigtop does packaging. I plan to work on it next week, but any help would be appreciated. Its pretty easy to deploy locally (without the need to run the puppet master, etc) and test the code: just do puppet puppet --modulepath `pwd`/modules manifests/example.pp where example.pp is a subset of a cluster.pp manifest appropriate for a single node testing.

        Show
        Roman Shaposhnik added a comment - Yup, all the nuts-n-bolts for making both secure and unsecure Hadoop deployments have been pushed. The only thing that's left is to tweak the code a little bit to be be 100% compatible with how Bigtop does packaging. I plan to work on it next week, but any help would be appreciated. Its pretty easy to deploy locally (without the need to run the puppet master, etc) and test the code: just do puppet puppet --modulepath `pwd`/modules manifests/example.pp where example.pp is a subset of a cluster.pp manifest appropriate for a single node testing.
        Hide
        Konstantin Boudnik added a comment -

        I see you have committed kerb recipes as well. Great!

        Show
        Konstantin Boudnik added a comment - I see you have committed kerb recipes as well. Great!
        Hide
        Roman Shaposhnik added a comment -

        Given how huge a diff it was I simply committed. Please chime in if you see that something is not quite kosher. And I'd be happy to take any kind of feedback into account ASAP.

        Show
        Roman Shaposhnik added a comment - Given how huge a diff it was I simply committed. Please chime in if you see that something is not quite kosher. And I'd be happy to take any kind of feedback into account ASAP.

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Roman Shaposhnik
          • Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development