Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-685

Use the user-to-groups mapping service in the NameNode

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HADOOP-4656 introduces a user-to-groups mapping service on the server-side. The NameNode should use this to map users to their groups rather than relying on the information passed by the client.

      1. MR-1083-0_20.2.patch
        59 kB
        Jitendra Nath Pandey
      2. HDFS-685-6.patch
        22 kB
        Boris Shkolnik
      3. HDFS-685-5.patch
        22 kB
        Boris Shkolnik
      4. HDFS-685-4.patch
        22 kB
        Boris Shkolnik
      5. HADOOP-4656_hdfs.patch
        9 kB
        Arun C Murthy

        Issue Links

          Activity

          Hide
          Arun C Murthy added a comment -

          Preliminary patch, with some testing complete.

          Show
          Arun C Murthy added a comment - Preliminary patch, with some testing complete.
          Hide
          Boris Shkolnik added a comment -

          we cannot run it on hudson (because it requires common changes that are not there)
          I ran test-patch locally:
          +1 overall.
          [exec]
          [exec] +1 @author. The patch does not contain any @author tags.
          [exec]
          [exec] +1 tests included. The patch appears to include 11 new or modified tests.
          [exec]
          [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
          [exec]
          [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
          [exec]
          [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
          [exec]
          [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
          [exec]

          Show
          Boris Shkolnik added a comment - we cannot run it on hudson (because it requires common changes that are not there) I ran test-patch locally: +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 11 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. [exec]
          Hide
          Boris Shkolnik added a comment -

          addressed review's comments from Jakob

          Show
          Boris Shkolnik added a comment - addressed review's comments from Jakob
          Hide
          Jakob Homan added a comment -

          +1 pending Hudson for v6 of patch. We can use Mockito for some of the explicit extension of classes for mocking purposes, but I believe this code is going to churn a lot with the new UGI stuff that's coming, so I'm not concerned about using it now.

          Show
          Jakob Homan added a comment - +1 pending Hudson for v6 of patch. We can use Mockito for some of the explicit extension of classes for mocking purposes, but I believe this code is going to churn a lot with the new UGI stuff that's coming, so I'm not concerned about using it now.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12428375/HDFS-685-6.patch
          against trunk revision 891593.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 11 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/151/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/151/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/151/artifact/trunk/build/test/checkstyle-errors.html
          Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/151/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12428375/HDFS-685-6.patch against trunk revision 891593. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 11 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/151/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/151/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/151/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/151/console This message is automatically generated.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #150 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/150/)
          . Use the user-to-groups mapping service in the NameNode. (boryas, acmurthy)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #150 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/150/ ) . Use the user-to-groups mapping service in the NameNode. (boryas, acmurthy)
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #176 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/176/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #176 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/176/ )
          Hide
          Hudson added a comment -

          Integrated in Hdfs-Patch-h5.grid.sp2.yahoo.net #154 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/154/)

          Show
          Hudson added a comment - Integrated in Hdfs-Patch-h5.grid.sp2.yahoo.net #154 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/154/ )
          Hide
          Jitendra Nath Pandey added a comment -

          Combined patch for HADOOP-4656, HDFS-685 and MAPREDUCE-1083 for Hadoop-20.

          Show
          Jitendra Nath Pandey added a comment - Combined patch for HADOOP-4656 , HDFS-685 and MAPREDUCE-1083 for Hadoop-20.
          Hide
          Hudson added a comment -

          Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #94 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/94/)

          Show
          Hudson added a comment - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #94 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/94/ )

            People

            • Assignee:
              Boris Shkolnik
              Reporter:
              Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development