Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2411

with webhdfs enabled in secure mode the auth to local mappings are not being respected.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.205.0
    • Fix Version/s: 0.20.205.0, 0.23.0, 0.24.0
    • Component/s: webhdfs
    • Labels:
      None
    1. HDFS-2411-trunk.patch
      0.8 kB
      Jitendra Nath Pandey
    2. HDFS-2411-branch-0.20-security.patch
      2 kB
      Jitendra Nath Pandey

      Issue Links

        Activity

        Hide
        Arpit Gupta added a comment -

        the jobtracker fails to connect to the namenode because the auth to local mappings are not being respected and the jt user if not mapped has no rights to write to hdfs.

        Show
        Arpit Gupta added a comment - the jobtracker fails to connect to the namenode because the auth to local mappings are not being respected and the jt user if not mapped has no rights to write to hdfs.
        Hide
        Jitendra Nath Pandey added a comment -

        Patch uploaded. I think KerberosAuthenticationHandler should not initialize KerberosName. KerberosName will be initialized when UserGroupInformation is initialized, and that setting should be used everywhere.

        Show
        Jitendra Nath Pandey added a comment - Patch uploaded. I think KerberosAuthenticationHandler should not initialize KerberosName. KerberosName will be initialized when UserGroupInformation is initialized, and that setting should be used everywhere.
        Hide
        Tsz Wo Nicholas Sze added a comment -

        +1 patch looks good. Please test it manually.

        Show
        Tsz Wo Nicholas Sze added a comment - +1 patch looks good. Please test it manually.
        Hide
        Jitendra Nath Pandey added a comment -

        I tested the patch manually, by installing a secure cluster.

        Show
        Jitendra Nath Pandey added a comment - I tested the patch manually, by installing a secure cluster.
        Hide
        Matt Foley added a comment -

        Leaving open for potential trunk patch.

        Show
        Matt Foley added a comment - Leaving open for potential trunk patch.
        Hide
        Jitendra Nath Pandey added a comment -

        Patch for trunk.

        Show
        Jitendra Nath Pandey added a comment - Patch for trunk.
        Hide
        Jitendra Nath Pandey added a comment -

        Part of the trunk patch is in HADOOP-7766.

        Show
        Jitendra Nath Pandey added a comment - Part of the trunk patch is in HADOOP-7766 .
        Hide
        Tsz Wo Nicholas Sze added a comment -

        +1 for the trunk patch.

        Show
        Tsz Wo Nicholas Sze added a comment - +1 for the trunk patch.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12500627/HDFS-2411-trunk.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests:
        org.apache.hadoop.hdfs.TestFileAppend2
        org.apache.hadoop.hdfs.TestBalancerBandwidth

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/1457//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1457//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12500627/HDFS-2411-trunk.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.hdfs.TestFileAppend2 org.apache.hadoop.hdfs.TestBalancerBandwidth +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/1457//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1457//console This message is automatically generated.
        Hide
        Jitendra Nath Pandey added a comment -

        The two failing tests are not related to this patch. This patch was manually tested on a secure cluster on branch-0.20-security.

        Show
        Jitendra Nath Pandey added a comment - The two failing tests are not related to this patch. This patch was manually tested on a secure cluster on branch-0.20-security.
        Hide
        Jitendra Nath Pandey added a comment -

        Note that HADOOP-7766 patch is also required to fix this issue completely.

        Show
        Jitendra Nath Pandey added a comment - Note that HADOOP-7766 patch is also required to fix this issue completely.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1159 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1159/)
        HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled.

        jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189355
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1159 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1159/ ) HDFS-2411 . The auth to local mappings are not respected with webhdfs and security enabled. jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189355 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1237 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1237/)
        HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled.

        jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189355
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1237 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1237/ ) HDFS-2411 . The auth to local mappings are not respected with webhdfs and security enabled. jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189355 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1173 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1173/)
        HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled.

        jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189355
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1173 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1173/ ) HDFS-2411 . The auth to local mappings are not respected with webhdfs and security enabled. jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189355 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Hide
        Tsz Wo Nicholas Sze added a comment -

        Merged to 0.23.

        Show
        Tsz Wo Nicholas Sze added a comment - Merged to 0.23.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #66 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/66/)
        svn merge -c 1189355 from trunk for HDFS-2411.

        szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189505
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #66 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/66/ ) svn merge -c 1189355 from trunk for HDFS-2411 . szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189505 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #65 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/65/)
        svn merge -c 1189355 from trunk for HDFS-2411.

        szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189505
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #65 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/65/ ) svn merge -c 1189355 from trunk for HDFS-2411 . szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189505 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #61 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/61/)
        svn merge -c 1189355 from trunk for HDFS-2411.

        szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189505
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #61 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/61/ ) svn merge -c 1189355 from trunk for HDFS-2411 . szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189505 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Hide
        Jitendra Nath Pandey added a comment -

        This is committed.

        Show
        Jitendra Nath Pandey added a comment - This is committed.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #52 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/52/)
        svn merge -c 1189355 from trunk for HDFS-2411.

        szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189505
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #52 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/52/ ) svn merge -c 1189355 from trunk for HDFS-2411 . szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189505 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #873 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/873/)
        HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled.

        jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189355
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #873 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/873/ ) HDFS-2411 . The auth to local mappings are not respected with webhdfs and security enabled. jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189355 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #64 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/64/)
        svn merge -c 1189355 from trunk for HDFS-2411.

        szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189505
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #64 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/64/ ) svn merge -c 1189355 from trunk for HDFS-2411 . szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189505 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #845 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/845/)
        HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled.

        jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189355
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #845 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/845/ ) HDFS-2411 . The auth to local mappings are not respected with webhdfs and security enabled. jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189355 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

          People

          • Assignee:
            Jitendra Nath Pandey
            Reporter:
            Arpit Gupta
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development