Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15726

Create utility to limit frequency of log statements

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.10.0, 3.2.0, 3.0.4, 3.1.2
    • common, util
    • None

    Description

      There is a common pattern of logging a behavior that is normally extraneous. Under some circumstances, such a behavior becomes common, flooding the logs and making it difficult to see what else is going on in the system. Under such situations it is beneficial to limit how frequently the extraneous behavior is logged, while capturing some summary information about the suppressed log statements.

      This is currently implemented in FSNamesystemLock (in HDFS-10713). We have additional use cases for this in HDFS-13791, so this is a good time to create a common utility for different sites to share this logic.

      Attachments

        1. HDFS-15726-branch-3.0.003.patch
          25 kB
          Erik Krogen
        2. HADOOP-15726.003.patch
          25 kB
          Erik Krogen
        3. HADOOP-15726.002.patch
          25 kB
          Erik Krogen
        4. HADOOP-15726.001.patch
          24 kB
          Erik Krogen
        5. HADOOP-15726.000.patch
          24 kB
          Erik Krogen

        Issue Links

          Activity

            People

              xkrogen Erik Krogen
              xkrogen Erik Krogen
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: