Bigtop
  1. Bigtop
  2. BIGTOP-95

Puppet-based deployment infrastructure needs to be added to bigtop

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.1.0
    • Fix Version/s: 0.2.0
    • Component/s: general, tests
    • Labels:
      None

      Description

      In order to facilitate dynamic bringup/teardown of Bigtop cluster for the purposes of stack validation we need to have an infrastructure that lets us:
      1. continuously deploy Bigtop packages from Jenkis artifacts
      2. do the required amount of configuration management
      3. be able to auto-deploy Bigtop dependencies such as databases, etc.

      Puppet seems to be the preferred CM solution that fits the above uses cases rather well.

        Activity

        Roman Shaposhnik created issue -
        Hide
        Roman Shaposhnik added a comment -

        Given how huge a diff it was I simply committed. Please chime in if you see that something is not quite kosher. And I'd be happy to take any kind of feedback into account ASAP.

        Show
        Roman Shaposhnik added a comment - Given how huge a diff it was I simply committed. Please chime in if you see that something is not quite kosher. And I'd be happy to take any kind of feedback into account ASAP.
        Hide
        Konstantin Boudnik added a comment -

        I see you have committed kerb recipes as well. Great!

        Show
        Konstantin Boudnik added a comment - I see you have committed kerb recipes as well. Great!
        Hide
        Roman Shaposhnik added a comment -

        Yup, all the nuts-n-bolts for making both secure and unsecure Hadoop deployments have been pushed. The only thing that's left is to tweak the code a little bit to be be 100% compatible with how Bigtop does packaging. I plan to work on it next week, but any help would be appreciated. Its pretty easy to deploy locally (without the need to run the puppet master, etc) and test the code: just do puppet puppet --modulepath `pwd`/modules manifests/example.pp where example.pp is a subset of a cluster.pp manifest appropriate for a single node testing.

        Show
        Roman Shaposhnik added a comment - Yup, all the nuts-n-bolts for making both secure and unsecure Hadoop deployments have been pushed. The only thing that's left is to tweak the code a little bit to be be 100% compatible with how Bigtop does packaging. I plan to work on it next week, but any help would be appreciated. Its pretty easy to deploy locally (without the need to run the puppet master, etc) and test the code: just do puppet puppet --modulepath `pwd`/modules manifests/example.pp where example.pp is a subset of a cluster.pp manifest appropriate for a single node testing.
        Hide
        Bruno Mahé added a comment -

        +1 LGTM

        Show
        Bruno Mahé added a comment - +1 LGTM
        Roman Shaposhnik made changes -
        Field Original Value New Value
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Gavin made changes -
        Workflow no-reopen-closed, patch-avail [ 12632985 ] patch-available, re-open possible [ 12666244 ]
        Roman Shaposhnik made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Anonymous made changes -
        Status Closed [ 6 ] Reopened [ 4 ]
        Roman Shaposhnik made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Roman Shaposhnik made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        41d 23h 28m 1 Roman Shaposhnik 25/Oct/11 23:09
        Closed Closed Reopened Reopened
        232d 4h 1 13/Feb/13 19:58
        Reopened Reopened Resolved Resolved
        128d 3h 58m 1 Roman Shaposhnik 22/Jun/13 00:57
        Resolved Resolved Closed Closed
        244d 17h 48m 2 Roman Shaposhnik 22/Jun/13 00:57

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Roman Shaposhnik
          • Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development