Hadoop Common
  1. Hadoop Common
  2. HADOOP-10015

UserGroupInformation prints out excessive ERROR warnings

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 2.4.0
    • Component/s: security
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In UserGroupInformation::doAs(), it prints out a log at ERROR level whenever it catches an exception.

      However, it prints benign warnings in the following paradigm:

       try {
              ugi.doAs(new PrivilegedExceptionAction<FileStatus>() {
                @Override
                public FileStatus run() throws Exception {
                  return fs.getFileStatus(nonExist);
                }
              });
            } catch (FileNotFoundException e) {
            }
      

      For example, FileSystem#exists() follows this paradigm. Distcp uses this paradigm too. The exception is expected therefore there should be no ERROR logs printed in the namenode logs.

      Currently, the user quickly finds out that the namenode log is quickly filled by benign ERROR logs when he or she runs distcp in secure set up. This behavior confuses the operators.

      This jira proposes to move the log to DEBUG level.

      1. 10015.v3.patch
        2 kB
        Nicolas Liochon
      2. 10015.v4.patch
        2 kB
        Nicolas Liochon
      3. 10015.v5.patch
        0.9 kB
        Nicolas Liochon
      4. 10015.v6.patch
        0.9 kB
        Nicolas Liochon
      5. HADOOP-10015.000.patch
        1 kB
        Haohui Mai
      6. HADOOP-10015.001.patch
        4 kB
        Haohui Mai
      7. HADOOP-10015.002.patch
        4 kB
        Haohui Mai

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Nicolas Liochon
              Reporter:
              Haohui Mai
            • Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development