Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2749

Kerberos configuration error when using short names in multiple HDFS Sinks

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: v1.6.0
    • Fix Version/s: v1.7.0
    • Component/s: None
    • Labels:
      None

      Description

      When we have more thank one HDFS Sink, configured in kerberos mode, and principal is configured with a short name like 'flume' (without the @REALM information), we get a

      java.lang.IllegalStateException: Cannot use multiple kerberos principals in the same agent. Must restart agent to use new principal or keytab. Previous = flume@EXAMPLE.COM (auth:KERBEROS), New = flume
      at com.google.common.base.Preconditions.checkState(Preconditions.java:172)
      at org.apache.flume.auth.KerberosAuthenticator.authenticate(KerberosAuthenticator.java:131)
      at org.apache.flume.auth.FlumeAuthenticationUtil.getAuthenticator(FlumeAuthenticationUtil.java:67)
      at org.apache.flume.sink.hdfs.HDFSEventSink.configure(HDFSEventSink.java:261)

        Activity

        Hide
        jrufus Johny Rufus added a comment -

        Modified to pre-1.6 style of checking if the current user trying to log in, is different than the already logged in user (Using KerberosUser class, that stores the configured Principal and keytab)

        Show
        jrufus Johny Rufus added a comment - Modified to pre-1.6 style of checking if the current user trying to log in, is different than the already logged in user (Using KerberosUser class, that stores the configured Principal and keytab)
        Hide
        hshreedharan Hari Shreedharan added a comment -

        Looks good. Running tests now.

        Show
        hshreedharan Hari Shreedharan added a comment - Looks good. Running tests now.
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit a4946111383b3dfdb4c128fe5390ff3983213cbb in flume's branch refs/heads/trunk from Hari Shreedharan
        [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=a494611 ]

        FLUME-2749. Fix kerberos configuration error when using short names in multiple HDFS Sinks

        (Johny Rufus via Hari)

        Show
        jira-bot ASF subversion and git services added a comment - Commit a4946111383b3dfdb4c128fe5390ff3983213cbb in flume's branch refs/heads/trunk from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=a494611 ] FLUME-2749 . Fix kerberos configuration error when using short names in multiple HDFS Sinks (Johny Rufus via Hari)
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 1161b044930579ebb803685753eb5b3363ee5178 in flume's branch refs/heads/flume-1.7 from Hari Shreedharan
        [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=1161b04 ]

        FLUME-2749. Fix kerberos configuration error when using short names in multiple HDFS Sinks

        (Johny Rufus via Hari)

        Show
        jira-bot ASF subversion and git services added a comment - Commit 1161b044930579ebb803685753eb5b3363ee5178 in flume's branch refs/heads/flume-1.7 from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=1161b04 ] FLUME-2749 . Fix kerberos configuration error when using short names in multiple HDFS Sinks (Johny Rufus via Hari)
        Hide
        hshreedharan Hari Shreedharan added a comment -

        Committed! Thanks Johny!

        Show
        hshreedharan Hari Shreedharan added a comment - Committed! Thanks Johny!
        Hide
        hudson Hudson added a comment -

        UNSTABLE: Integrated in Flume-trunk-hbase-1 #114 (See https://builds.apache.org/job/Flume-trunk-hbase-1/114/)
        FLUME-2749. Fix kerberos configuration error when using short names in multiple HDFS Sinks (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=a4946111383b3dfdb4c128fe5390ff3983213cbb)

        • flume-ng-auth/src/main/java/org/apache/flume/auth/FlumeAuthenticationUtil.java
        • flume-ng-auth/src/main/java/org/apache/flume/auth/KerberosAuthenticator.java
        • flume-ng-auth/src/test/java/org/apache/flume/auth/TestFlumeAuthenticator.java
        • flume-ng-auth/src/main/java/org/apache/flume/auth/KerberosUser.java
        Show
        hudson Hudson added a comment - UNSTABLE: Integrated in Flume-trunk-hbase-1 #114 (See https://builds.apache.org/job/Flume-trunk-hbase-1/114/ ) FLUME-2749 . Fix kerberos configuration error when using short names in multiple HDFS Sinks (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=a4946111383b3dfdb4c128fe5390ff3983213cbb ) flume-ng-auth/src/main/java/org/apache/flume/auth/FlumeAuthenticationUtil.java flume-ng-auth/src/main/java/org/apache/flume/auth/KerberosAuthenticator.java flume-ng-auth/src/test/java/org/apache/flume/auth/TestFlumeAuthenticator.java flume-ng-auth/src/main/java/org/apache/flume/auth/KerberosUser.java

          People

          • Assignee:
            jrufus Johny Rufus
            Reporter:
            jrufus Johny Rufus
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development