Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6823

dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 2.6.0
    • Component/s: namenode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Starting the namenode on a system not running Kerberos results in the following showing up in the log:

      2014-08-05 15:02:33,747 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Clients are to use aw-mbp-work.local:9000 to access this namenode/service.
      2014-08-05 15:02:33,831 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      2014-08-05 15:02:33,948 INFO org.apache.hadoop.hdfs.DFSUtil: Starting web server as: ${dfs.web.authentication.kerberos.principal}
      2014-08-05 15:02:33,948 INFO org.apache.hadoop.hdfs.DFSUtil: Starting Web-server for hdfs at: http://aw-mbp-work.local:50070
      

      If Kerberos isn't configured, we shouldn't try to display the principal message, never mind the raw text of the configuration option.

      1. HDFS-6823.patch
        1 kB
        Allen Wittenauer

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Patch Available Patch Available Open Open
        8m 18s 1 Allen Wittenauer 06/Aug/14 00:26
        Open Open Patch Available Patch Available
        33m 26s 2 Allen Wittenauer 06/Aug/14 00:26
        Patch Available Patch Available Resolved Resolved
        2d 19h 3m 1 Ravi Prakash 08/Aug/14 19:29
        Resolved Resolved Closed Closed
        114d 8h 38m 1 Arun C Murthy 01/Dec/14 03:08
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Allen Wittenauer made changes -
        Fix Version/s 3.0.0 [ 12320356 ]
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1858 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1858/)
        HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616846)

        Show
        Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1858 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1858/ ) HDFS-6823 . dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616846 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt HDFS-6823 . dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616845 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Hdfs-trunk #1832 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1832/)
        HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616846)

        Show
        Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk #1832 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1832/ ) HDFS-6823 . dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616846 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt HDFS-6823 . dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616845 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk #639 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/639/)
        HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616846)

        Show
        Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #639 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/639/ ) HDFS-6823 . dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616846 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt HDFS-6823 . dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616845 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #6038 (See https://builds.apache.org/job/Hadoop-trunk-Commit/6038/)
        HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616846)

        Show
        Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #6038 (See https://builds.apache.org/job/Hadoop-trunk-Commit/6038/ ) HDFS-6823 . dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616846 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt HDFS-6823 . dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS (raviprak: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1616845 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java
        Ravi Prakash made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 3.0.0 [ 12320356 ]
        Fix Version/s 2.6.0 [ 12327181 ]
        Resolution Fixed [ 1 ]
        Ravi Prakash made changes -
        Assignee Allen Wittenauer [ aw ]
        Affects Version/s 3.0.0 [ 12320356 ]
        Target Version/s 3.0.0, 2.6.0 [ 12320356, 12327181 ]
        Hide
        Ravi Prakash added a comment -

        Committed! Thanks Allen!

        Show
        Ravi Prakash added a comment - Committed! Thanks Allen!
        Hide
        Ravi Prakash added a comment -

        Patch looks good to me. +1. The unit test failure is unrelated. It fails on an unpatched build as well. HDFS-4663 is open (although for an OOM, I don't think it makes sense to create another JIRA.)

        Will commit shortly. Thanks Allen!

        Show
        Ravi Prakash added a comment - Patch looks good to me. +1. The unit test failure is unrelated. It fails on an unpatched build as well. HDFS-4663 is open (although for an OOM, I don't think it makes sense to create another JIRA.) Will commit shortly. Thanks Allen!
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12659998/HDFS-6823.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

        org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7565//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7565//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12659998/HDFS-6823.patch against trunk revision . +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7565//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7565//console This message is automatically generated.
        Allen Wittenauer made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Allen Wittenauer made changes -
        Attachment HDFS-6823.patch [ 12659998 ]
        Allen Wittenauer made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Allen Wittenauer made changes -
        Attachment HDFS-6823.patch [ 12659995 ]
        Allen Wittenauer made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Allen Wittenauer made changes -
        Attachment HDFS-6823.patch [ 12659995 ]
        Hide
        Allen Wittenauer added a comment -

        Simple log message patch, no test.

        Show
        Allen Wittenauer added a comment - Simple log message patch, no test.
        Allen Wittenauer made changes -
        Field Original Value New Value
        Component/s namenode [ 12312926 ]
        Allen Wittenauer created issue -

          People

          • Assignee:
            Allen Wittenauer
            Reporter:
            Allen Wittenauer
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development