Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14628

Improve information on scanAndCompactStorages in BlockManager and lower log level

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 3.1.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      BlockManager#scanAndCompactStorages is called every 600sec by default.
      In big cluster with thousands of datanodes, it will print out 10 thousands of informations every sec when scanAndCompactStorages() is running,which may make much noise in namenode logs. And, currently these INFO logs at namenode side and does not provide much information.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                shenyinjie Shen Yinjie
                Reporter:
                shenyinjie Shen Yinjie
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: