Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12943 Consistent Reads from Standby Node
  3. HDFS-13791

Limit logging frequency of edit tail related statements

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HDFS-12943, 3.3.0
    • Component/s: hdfs, qjm
    • Labels:
      None

      Description

      There are a number of log statements that occur every time new edits are tailed by a Standby NameNode. When edits are tailing only on the order of every tens of seconds, this is fine. With the work in HDFS-13150, however, edits may be tailed every few milliseconds, which can flood the logs with tailing-related statements. We should throttle it to limit it to printing at most, say, once per 5 seconds.

      We can implement logic similar to that used in HDFS-10713. This may be slightly more tricky since the log statements are distributed across a few classes.

        Attachments

        1. HDFS-13791-HDFS-12943.000.patch
          18 kB
          Erik Krogen
        2. HDFS-13791-HDFS-12943.001.patch
          19 kB
          Erik Krogen
        3. HDFS-13791-HDFS-12943.002.patch
          31 kB
          Erik Krogen
        4. HDFS-13791-HDFS-12943.003.patch
          34 kB
          Erik Krogen
        5. HDFS-13791-HDFS-12943.004.patch
          10 kB
          Erik Krogen
        6. HDFS-13791-HDFS-12943.005.patch
          16 kB
          Erik Krogen
        7. HDFS-13791-HDFS-12943.006.patch
          16 kB
          Erik Krogen

          Issue Links

            Activity

              People

              • Assignee:
                xkrogen Erik Krogen
                Reporter:
                xkrogen Erik Krogen
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: