Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12943 Consistent Reads from Standby Node
  3. HDFS-13791

Limit logging frequency of edit tail related statements

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-12943, 3.3.0
    • hdfs, qjm
    • None

    Description

      There are a number of log statements that occur every time new edits are tailed by a Standby NameNode. When edits are tailing only on the order of every tens of seconds, this is fine. With the work in HDFS-13150, however, edits may be tailed every few milliseconds, which can flood the logs with tailing-related statements. We should throttle it to limit it to printing at most, say, once per 5 seconds.

      We can implement logic similar to that used in HDFS-10713. This may be slightly more tricky since the log statements are distributed across a few classes.

      Attachments

        1. HDFS-13791-HDFS-12943.000.patch
          18 kB
          Erik Krogen
        2. HDFS-13791-HDFS-12943.001.patch
          19 kB
          Erik Krogen
        3. HDFS-13791-HDFS-12943.002.patch
          31 kB
          Erik Krogen
        4. HDFS-13791-HDFS-12943.003.patch
          34 kB
          Erik Krogen
        5. HDFS-13791-HDFS-12943.004.patch
          10 kB
          Erik Krogen
        6. HDFS-13791-HDFS-12943.005.patch
          16 kB
          Erik Krogen
        7. HDFS-13791-HDFS-12943.006.patch
          16 kB
          Erik Krogen

        Issue Links

          Activity

            People

              xkrogen Erik Krogen
              xkrogen Erik Krogen
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: