Bigtop
  1. Bigtop
  2. BIGTOP-1161

Have a way to dynamically select components to be deployed by Puppet recipes.

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.8.0
    • Component/s: deployment

      Description

      There are situations where installing the whole stack of the components into a designated cluster is too heavy for development or testing purposes. Say, at times I want to have just HDFS and HBase, or HDFS, MR, and Pig.

      Currently, you'll have to hack into cluster.pp and remove parts of the recipe.

      It'd be great to have an ability to configure the set of the components in the config/site.csv and only those configured would be deployed.

      1. BIGTOP-1161.patch
        14 kB
        Konstantin Boudnik

        Activity

        Hide
        Konstantin Boudnik added a comment -

        That would do it. Perhaps, there's a more elegant way to deal with empty arrays in Puppet, but I am not aware of any.

        Show
        Konstantin Boudnik added a comment - That would do it. Perhaps, there's a more elegant way to deal with empty arrays in Puppet, but I am not aware of any.
        Hide
        jay vyas added a comment -

        Roman Shaposhnik

        Did you mean "BIGTOP_DEPLOY_PATH/config/site.csv" when you say "site.xml"? Just checking.... sounds like you mixed your hadoop hat with your puppet hat in that comment.

        Show
        jay vyas added a comment - Roman Shaposhnik Did you mean "BIGTOP_DEPLOY_PATH/config/site.csv" when you say "site.xml"? Just checking.... sounds like you mixed your hadoop hat with your puppet hat in that comment.
        Hide
        Konstantin Boudnik added a comment -

        Yup, good catch!

        Show
        Konstantin Boudnik added a comment - Yup, good catch!
        Hide
        jay vyas added a comment -

        (bump) may we push this patch in ? It will be a big feature for for https://issues.apache.org/jira/browse/BIGTOP-1171 , which aims to provision on the fly with vagrant - by moving all info into site.csv ~ we make provisioning via puppet extremely flexible.

        Show
        jay vyas added a comment - (bump) may we push this patch in ? It will be a big feature for for https://issues.apache.org/jira/browse/BIGTOP-1171 , which aims to provision on the fly with vagrant - by moving all info into site.csv ~ we make provisioning via puppet extremely flexible.
        Hide
        Roman Shaposhnik added a comment -

        +1. Please commit.

        Show
        Roman Shaposhnik added a comment - +1. Please commit.
        Hide
        Konstantin Boudnik added a comment -

        Pushed to master as bd559f7

        Show
        Konstantin Boudnik added a comment - Pushed to master as bd559f7
        Hide
        jay vyas added a comment -

        i just looked at the components[0]==undef code block. initially it was a little confusing why it was there, then i realized that its to provide backwards compatibility. will update the READMe/comments in BIGTOP-1365. but just leaving this comment for folks wondering the same thing that i was

        Show
        jay vyas added a comment - i just looked at the components [0] ==undef code block. initially it was a little confusing why it was there, then i realized that its to provide backwards compatibility . will update the READMe/comments in BIGTOP-1365 . but just leaving this comment for folks wondering the same thing that i was

          People

          • Assignee:
            Konstantin Boudnik
            Reporter:
            Konstantin Boudnik
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development