Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15726

Create utility to limit frequency of log statements

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.10.0, 3.2.0, 3.0.4, 3.1.2
    • common, util
    • None

    Description

      There is a common pattern of logging a behavior that is normally extraneous. Under some circumstances, such a behavior becomes common, flooding the logs and making it difficult to see what else is going on in the system. Under such situations it is beneficial to limit how frequently the extraneous behavior is logged, while capturing some summary information about the suppressed log statements.

      This is currently implemented in FSNamesystemLock (in HDFS-10713). We have additional use cases for this in HDFS-13791, so this is a good time to create a common utility for different sites to share this logic.

      Attachments

        1. HADOOP-15726.000.patch
          24 kB
          Erik Krogen
        2. HADOOP-15726.001.patch
          24 kB
          Erik Krogen
        3. HADOOP-15726.002.patch
          25 kB
          Erik Krogen
        4. HADOOP-15726.003.patch
          25 kB
          Erik Krogen
        5. HDFS-15726-branch-3.0.003.patch
          25 kB
          Erik Krogen

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            xkrogen Erik Krogen
            xkrogen Erik Krogen
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment