Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1669

puppet: Hadoop: Separate dependencies on Kerberos keytabs

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 1.0.0
    • Component/s: deployment
    • Labels:
      None

      Description

      When trying to set up a node as only a datanode but with Kerberos security class hadoop::kerberos pulls in a dependency on package hadoop-yarn which makes puppet fail. This patch puts keytab creation into their respective component classes.

      Also it corrects an insufficient dependency on "namenode format" by the datanode since the datanode needs the namenode to actually run before it can work.

        Activity

        Hide
        michaelweiser Michael Weiser added a comment -

        updated patch that also cleans up the variable namespace in hadoop::common where hadoop_security_authentication isn't needed any more.

        Show
        michaelweiser Michael Weiser added a comment - updated patch that also cleans up the variable namespace in hadoop::common where hadoop_security_authentication isn't needed any more.
        Hide
        evans_ye Evans Ye added a comment -

        I'll take a look on this with BIGTOP-1670.

        Show
        evans_ye Evans Ye added a comment - I'll take a look on this with BIGTOP-1670 .
        Hide
        evans_ye Evans Ye added a comment -

        Ok, so there's an issue when configuring only hadoop in components settings:

        Error: Could not find dependency Package[hadoop-yarn] for Kerberos::Host_keytab[yarn] at /bigtop-home/bigtop-deploy/puppet/modules/hadoop/manifests/init.pp:46
        

        Tested and this fixed the problem. +1. I'll commit this.

        Show
        evans_ye Evans Ye added a comment - Ok, so there's an issue when configuring only hadoop in components settings: Error: Could not find dependency Package[hadoop-yarn] for Kerberos::Host_keytab[yarn] at /bigtop-home/bigtop-deploy/puppet/modules/hadoop/manifests/init.pp:46 Tested and this fixed the problem. +1. I'll commit this.
        Hide
        evans_ye Evans Ye added a comment -

        Committed. Thanks Michael Weiser].

        Show
        evans_ye Evans Ye added a comment - Committed. Thanks Michael Weiser ].

          People

          • Assignee:
            michaelweiser Michael Weiser
            Reporter:
            michaelweiser Michael Weiser
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development