Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-2708

puppet code always installs hdfs by default

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.2.0
    • Component/s: deployment
    • Labels:
      None

      Description

      Right now our puppet code always installs HDFS by default. In fact there's a bit of a byzantine logic going on to select between HA HDFS and non-HA HDFS. I propose that we make HDFS a component just like any other. A lot of time HDFS is not needed (think GPDB or Zeppelin + Spark) and forcing it seems unnecessary.

      1. BIGTOP-2708.patch.txt
        1 kB
        Roman Shaposhnik

        Activity

        Hide
        rvs Roman Shaposhnik added a comment -

        I am attaching a pretty simple patch.

        Note that if this patch looks OK to everyone I'll have to change all the templates for our provisioners to explicitly include hdfs. E.g.:

        components: [hdfs, yarn]

        Show
        rvs Roman Shaposhnik added a comment - I am attaching a pretty simple patch. Note that if this patch looks OK to everyone I'll have to change all the templates for our provisioners to explicitly include hdfs. E.g.: components: [hdfs, yarn]
        Hide
        cos Konstantin Boudnik added a comment -

        There are also times when QFS might be wanted instead. The patch looks good!

        Show
        cos Konstantin Boudnik added a comment - There are also times when QFS might be wanted instead. The patch looks good!
        Hide
        evans_ye Evans Ye added a comment -

        +1.

        Show
        evans_ye Evans Ye added a comment - +1.

          People

          • Assignee:
            rvs Roman Shaposhnik
            Reporter:
            rvs Roman Shaposhnik
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development