Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15726

Create utility to limit frequency of log statements

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.10.0, 3.2.0, 3.0.4, 3.1.2
    • Component/s: common, util
    • Labels:
      None
    • Target Version/s:

      Description

      There is a common pattern of logging a behavior that is normally extraneous. Under some circumstances, such a behavior becomes common, flooding the logs and making it difficult to see what else is going on in the system. Under such situations it is beneficial to limit how frequently the extraneous behavior is logged, while capturing some summary information about the suppressed log statements.

      This is currently implemented in FSNamesystemLock (in HDFS-10713). We have additional use cases for this in HDFS-13791, so this is a good time to create a common utility for different sites to share this logic.

        Attachments

        1. HDFS-15726-branch-3.0.003.patch
          25 kB
          Erik Krogen
        2. HADOOP-15726.003.patch
          25 kB
          Erik Krogen
        3. HADOOP-15726.002.patch
          25 kB
          Erik Krogen
        4. HADOOP-15726.001.patch
          24 kB
          Erik Krogen
        5. HADOOP-15726.000.patch
          24 kB
          Erik Krogen

          Issue Links

            Activity

              People

              • Assignee:
                xkrogen Erik Krogen
                Reporter:
                xkrogen Erik Krogen
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: