Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10015

UserGroupInformation prints out excessive ERROR warnings

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.4.0
    • security
    • None
    • Reviewed

    Description

      In UserGroupInformation::doAs(), it prints out a log at ERROR level whenever it catches an exception.

      However, it prints benign warnings in the following paradigm:

       try {
              ugi.doAs(new PrivilegedExceptionAction<FileStatus>() {
                @Override
                public FileStatus run() throws Exception {
                  return fs.getFileStatus(nonExist);
                }
              });
            } catch (FileNotFoundException e) {
            }
      

      For example, FileSystem#exists() follows this paradigm. Distcp uses this paradigm too. The exception is expected therefore there should be no ERROR logs printed in the namenode logs.

      Currently, the user quickly finds out that the namenode log is quickly filled by benign ERROR logs when he or she runs distcp in secure set up. This behavior confuses the operators.

      This jira proposes to move the log to DEBUG level.

      Attachments

        1. 10015.v3.patch
          2 kB
          Nicolas Liochon
        2. 10015.v4.patch
          2 kB
          Nicolas Liochon
        3. 10015.v5.patch
          0.9 kB
          Nicolas Liochon
        4. 10015.v6.patch
          0.9 kB
          Nicolas Liochon
        5. HADOOP-10015.000.patch
          1 kB
          Haohui Mai
        6. HADOOP-10015.001.patch
          4 kB
          Haohui Mai
        7. HADOOP-10015.002.patch
          4 kB
          Haohui Mai

        Issue Links

          Activity

            People

              nkeywal Nicolas Liochon
              wheat9 Haohui Mai
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: