HBase
  1. HBase
  2. HBASE-11293

Master and Region servers fail to start when hbase.master.ipc.address=0.0.0.0, hbase.regionserver.ipc.address=0.0.0.0 and Kerberos is enabled

    Details

    • Type: Bug Bug
    • Status: Reopened
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Setting

      hbase.master.ipc.address=0.0.0.0
      hbase.regionserver.ipc.address=0.0.0.0
      

      causes the _HOST substitution in hbase/_HOST@EXAMPLE.COM to result in "hbase/0:0:0:0:0:0:0:0@EXAMPLE.COM which in turn causes kerberos authentication to fail.

      1. 11293-1.txt
        3 kB
        Devaraj Das

        Activity

        Michael Harp created issue -
        Hide
        Andrew Purtell added a comment -

        Do you need to be listening on multiple interfaces?

        Show
        Andrew Purtell added a comment - Do you need to be listening on multiple interfaces?
        Hide
        Michael Harp added a comment -

        Yes, we have multiple nics on all hosts.

        Show
        Michael Harp added a comment - Yes, we have multiple nics on all hosts.
        Hide
        Devaraj Das added a comment -

        The problem is that the hostname passed to the login call ends up being 0.0.0.0 instead of the actual hostname (the substitution of _HOST string is not the problem).
        In HMaster.java, the server's hostname is also obtained via Hadoop's DNS library code

        String hostname = Strings.domainNamePointerToHostName(DNS.getDefaultHost(
        

        In Hadoop's DNS.java, by default this hostname would be given by InetAddress.getLocalHost().getCanonicalHostName(). Maybe, we should pass the same in the login call ?

        Show
        Devaraj Das added a comment - The problem is that the hostname passed to the login call ends up being 0.0.0.0 instead of the actual hostname (the substitution of _HOST string is not the problem). In HMaster.java, the server's hostname is also obtained via Hadoop's DNS library code String hostname = Strings.domainNamePointerToHostName(DNS.getDefaultHost( In Hadoop's DNS.java, by default this hostname would be given by InetAddress.getLocalHost().getCanonicalHostName(). Maybe, we should pass the same in the login call ?
        Hide
        Andrew Purtell added a comment - - edited

        In Hadoop's DNS.java, by default this hostname would be given by InetAddress.getLocalHost().getCanonicalHostName(). Maybe, we should pass the same in the login call ?

        That could work, as long as we also respect the configuration settings 'hbase.regionserver.dns.interface' (the name of the interface we should retrieve the local IP address to look up the canonical hostname with) and 'hbase.regionserver.dns.nameserver' (the nameserver we should use for queries, including reverse IP lookups)

        Show
        Andrew Purtell added a comment - - edited In Hadoop's DNS.java, by default this hostname would be given by InetAddress.getLocalHost().getCanonicalHostName(). Maybe, we should pass the same in the login call ? That could work, as long as we also respect the configuration settings 'hbase.regionserver.dns.interface' (the name of the interface we should retrieve the local IP address to look up the canonical hostname with) and 'hbase.regionserver.dns.nameserver' (the nameserver we should use for queries, including reverse IP lookups)
        Hide
        Devaraj Das added a comment -

        This patch has been tested internally.

        Show
        Devaraj Das added a comment - This patch has been tested internally.
        Devaraj Das made changes -
        Field Original Value New Value
        Attachment 11293-1.txt [ 12649451 ]
        Hide
        Devaraj Das added a comment -

        Andrew Purtell, could you please take a look at the patch. Thanks!

        Show
        Devaraj Das added a comment - Andrew Purtell , could you please take a look at the patch. Thanks!
        Hide
        Ted Yu added a comment -

        lgtm

        Show
        Ted Yu added a comment - lgtm
        Hide
        Nick Dimiduk added a comment -

        +1

        Show
        Nick Dimiduk added a comment - +1
        Devaraj Das made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Assignee Devaraj Das [ devaraj ]
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12649451/11293-1.txt
        against trunk revision .
        ATTACHMENT ID: 12649451

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/9741//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12649451/11293-1.txt against trunk revision . ATTACHMENT ID: 12649451 +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/9741//console This message is automatically generated.
        Hide
        Devaraj Das added a comment -

        Will upload a trunk patch shortly. The patch uploaded last was for 0.98.x.

        Show
        Devaraj Das added a comment - Will upload a trunk patch shortly. The patch uploaded last was for 0.98.x.
        Hide
        Andrew Purtell added a comment -

        +1, would be good to have a test also

        Show
        Andrew Purtell added a comment - +1, would be good to have a test also
        Michael Harp made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Hide
        Devaraj Das added a comment -

        Michael Harp, this is not done yet. Trunk needs to have a patch.

        Show
        Devaraj Das added a comment - Michael Harp , this is not done yet. Trunk needs to have a patch.
        Devaraj Das made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Hide
        Enis Soztutar added a comment -

        Devaraj Das should we go forward with this patch?

        Show
        Enis Soztutar added a comment - Devaraj Das should we go forward with this patch?
        Hide
        Devaraj Das added a comment -

        Yes, will get to it this week.

        Show
        Devaraj Das added a comment - Yes, will get to it this week.
        Hide
        Devaraj Das added a comment -

        From what I can tell, this issue doesn't affect the branch-1+ branches.

        Show
        Devaraj Das added a comment - From what I can tell, this issue doesn't affect the branch-1+ branches.

          People

          • Assignee:
            Devaraj Das
            Reporter:
            Michael Harp
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:

              Development