Hadoop Common
  1. Hadoop Common
  2. HADOOP-8149

cap space usage of default log4j rolling policy

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0-alpha
    • Component/s: conf
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      Hadoop log files are now rolled by size instead of date (daily) by default. Tools that depend on the log file name format will need to be updated. Users who would like to maintain the previous settings of hadoop.root.logger and hadoop.security.logger can use their current log4j.properties files and update the HADOOP_ROOT_LOGGER and HADOOP_SECURITY_LOGGER environment variables to use DRFA and DRFAS respectively.
      Show
      Hadoop log files are now rolled by size instead of date (daily) by default. Tools that depend on the log file name format will need to be updated. Users who would like to maintain the previous settings of hadoop.root.logger and hadoop.security.logger can use their current log4j.properties files and update the HADOOP_ROOT_LOGGER and HADOOP_SECURITY_LOGGER environment variables to use DRFA and DRFAS respectively.

      Description

      I've seen several critical production issues because logs are not automatically removed after some time and accumulate. Changes to Hadoop's default log4j file appender would help with this.

      I recommend we move to an appender which:

      1) caps the max file size (configurable)
      2) caps the max number of files to keep (configurable)
      3) uses rolling file appender rather than DRFA, see the warning here:
      http://logging.apache.org/log4j/1.2/apidocs/org/apache/log4j/DailyRollingFileAppender.html
      Specifically: "DailyRollingFileAppender has been observed to exhibit synchronization issues and data loss."

      We'd lose (based on the default log4j configuration) the daily rolling aspect, however increase reliability.

      1. HADOOP-8149.patch
        17 kB
        Patrick Hunt
      2. HADOOP-8149.patch
        17 kB
        Patrick Hunt
      3. HADOOP-8149.patch
        18 kB
        Patrick Hunt
      4. HADOOP-8149.patch
        19 kB
        Patrick Hunt
      5. HADOOP-8149.patch
        21 kB
        Patrick Hunt

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Patrick Hunt
              Reporter:
              Patrick Hunt
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development