Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11554

Expose HadoopKerberosName as a hadoop subcommand

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: scripts
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      The hadoop kerbname subcommand has been added to ease operational pain in determining the output of auth_to_local rules.

      Description

      HadoopKerberosName has been around as a "secret hack" for quite a while. We should clean up the output and make it official by exposing it via the hadoop command.

      1. HADOOP-11554.patch
        1.0 kB
        Allen Wittenauer
      2. HADOOP-11554-01.patch
        3 kB
        Allen Wittenauer
      3. HADOOP-11554-02.patch
        4 kB
        Allen Wittenauer

        Issue Links

          Activity

          Hide
          aw Allen Wittenauer added a comment -

          -00:

          • Initial patch
          Show
          aw Allen Wittenauer added a comment - -00: Initial patch
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12696962/HADOOP-11554.patch
          against trunk revision 9d91069.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          -1 eclipse:eclipse. The patch failed to build with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5613//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5613//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12696962/HADOOP-11554.patch against trunk revision 9d91069. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. -1 eclipse:eclipse . The patch failed to build with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5613//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5613//console This message is automatically generated.
          Hide
          cnauroth Chris Nauroth added a comment -

          Thanks, Allen. This is a good idea.

          Would you please add the subcommand in hadoop.cmd too for consistency? I can volunteer to test on Windows.

          Let's add it to the documentation in CommandsManual.apt.vm. It's probably also worth a brief mention in SecureMode.apt.vm under the section "Mapping from Kerberos principal to OS user account".

          Show
          cnauroth Chris Nauroth added a comment - Thanks, Allen. This is a good idea. Would you please add the subcommand in hadoop.cmd too for consistency? I can volunteer to test on Windows. Let's add it to the documentation in CommandsManual.apt.vm. It's probably also worth a brief mention in SecureMode.apt.vm under the section "Mapping from Kerberos principal to OS user account".
          Hide
          aw Allen Wittenauer added a comment -

          -01:

          Thanks!

          Show
          aw Allen Wittenauer added a comment - -01: Address Chris Nauroth 's comments Thanks!
          Hide
          cnauroth Chris Nauroth added a comment -

          +1 pending Jenkins. I tested successfully on Windows. Thank you, Allen.

          Show
          cnauroth Chris Nauroth added a comment - +1 pending Jenkins. I tested successfully on Windows. Thank you, Allen.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12697142/HADOOP-11554-01.patch
          against trunk revision da2fb2b.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5619//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12697142/HADOOP-11554-01.patch against trunk revision da2fb2b. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5619//console This message is automatically generated.
          Hide
          cnauroth Chris Nauroth added a comment -

          That's another clearly bogus Jenkins run. The patch applies cleanly for me.

          Show
          cnauroth Chris Nauroth added a comment - That's another clearly bogus Jenkins run. The patch applies cleanly for me.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12697142/HADOOP-11554-01.patch
          against trunk revision d5855c0.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5647//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12697142/HADOOP-11554-01.patch against trunk revision d5855c0. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5647//console This message is automatically generated.
          Hide
          aw Allen Wittenauer added a comment -

          -02:

          • new patch generated to match updated doc format.
          Show
          aw Allen Wittenauer added a comment - -02: new patch generated to match updated doc format.
          Hide
          cnauroth Chris Nauroth added a comment -

          +1 for patch v02 pending Jenkins.

          Show
          cnauroth Chris Nauroth added a comment - +1 for patch v02 pending Jenkins.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12697940/HADOOP-11554-02.patch
          against trunk revision 7c6b654.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          -1 findbugs. The patch appears to introduce 2 new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5650//testReport/
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/5650//artifact/patchprocess/newPatchFindbugsWarningshadoop-common.html
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5650//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12697940/HADOOP-11554-02.patch against trunk revision 7c6b654. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. -1 findbugs . The patch appears to introduce 2 new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-common-project/hadoop-common. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5650//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/5650//artifact/patchprocess/newPatchFindbugsWarningshadoop-common.html Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5650//console This message is automatically generated.
          Hide
          cnauroth Chris Nauroth added a comment -

          The lack of tests is expected, since this patch doesn't touch Java code, and the Findbugs warnings are unrelated.

          Show
          cnauroth Chris Nauroth added a comment - The lack of tests is expected, since this patch doesn't touch Java code, and the Findbugs warnings are unrelated.
          Hide
          aw Allen Wittenauer added a comment -

          Committing this to trunk.

          Thanks for the review!

          Show
          aw Allen Wittenauer added a comment - Committing this to trunk. Thanks for the review!
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #7071 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7071/)
          HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe)

          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7071 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7071/ ) HADOOP-11554 . Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe) hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/102/)
          HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe)

          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/102/ ) HADOOP-11554 . Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe) hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #836 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/836/)
          HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe)

          • hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #836 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/836/ ) HADOOP-11554 . Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe) hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/hadoop
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2034 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2034/)
          HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe)

          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2034 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2034/ ) HADOOP-11554 . Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe) hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/hadoop
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #103 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/103/)
          HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe)

          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #103 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/103/ ) HADOOP-11554 . Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe) hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/src/main/bin/hadoop
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2053 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2053/)
          HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe)

          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2053 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2053/ ) HADOOP-11554 . Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe) hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #97 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/97/)
          HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe)

          • hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #97 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/97/ ) HADOOP-11554 . Expose HadoopKerberosName as a hadoop subcommand (aw) (aw: rev cfd8a2174afb1140b5042d913782b24615f32bfe) hadoop-common-project/hadoop-common/src/main/bin/hadoop.cmd hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-common-project/hadoop-common/CHANGES.txt

            People

            • Assignee:
              aw Allen Wittenauer
              Reporter:
              aw Allen Wittenauer
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development