Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14008

NN should log snapshotdiff report

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0, 3.1.1, 3.0.3
    • Fix Version/s: 3.3.0
    • Component/s: namenode
    • Labels:
      None

      Description

      It will be helpful to log message for snapshotdiff to correlate snapshotdiff operation against memory spikes in NN heap. It will be good to log the below details at the end of snapshot diff operation, this will help us to know the time spent in the snapshotdiff operation and to know the number of files/directories processed and compared.

      a) Total dirs processed

      b) Total dirs compared

      c) Total files processed

      d) Total files compared

      e) Total children listing time

        Attachments

        1. HDFS-14008.003.patch
          10 kB
          Pranay Singh
        2. HDFS-14008.002.patch
          10 kB
          Pranay Singh
        3. HDFS-14008.001.patch
          9 kB
          Pranay Singh

          Activity

            People

            • Assignee:
              pranay_singh Pranay Singh
              Reporter:
              pranay_singh Pranay Singh
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: