Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10015

UserGroupInformation prints out excessive ERROR warnings

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.4.0
    • security
    • None
    • Reviewed

    Description

      In UserGroupInformation::doAs(), it prints out a log at ERROR level whenever it catches an exception.

      However, it prints benign warnings in the following paradigm:

       try {
              ugi.doAs(new PrivilegedExceptionAction<FileStatus>() {
                @Override
                public FileStatus run() throws Exception {
                  return fs.getFileStatus(nonExist);
                }
              });
            } catch (FileNotFoundException e) {
            }
      

      For example, FileSystem#exists() follows this paradigm. Distcp uses this paradigm too. The exception is expected therefore there should be no ERROR logs printed in the namenode logs.

      Currently, the user quickly finds out that the namenode log is quickly filled by benign ERROR logs when he or she runs distcp in secure set up. This behavior confuses the operators.

      This jira proposes to move the log to DEBUG level.

      Attachments

        1. HADOOP-10015.002.patch
          4 kB
          Haohui Mai
        2. HADOOP-10015.001.patch
          4 kB
          Haohui Mai
        3. HADOOP-10015.000.patch
          1 kB
          Haohui Mai
        4. 10015.v6.patch
          0.9 kB
          Nicolas Liochon
        5. 10015.v5.patch
          0.9 kB
          Nicolas Liochon
        6. 10015.v4.patch
          2 kB
          Nicolas Liochon
        7. 10015.v3.patch
          2 kB
          Nicolas Liochon

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            nkeywal Nicolas Liochon
            wheat9 Haohui Mai
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment