Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-132

Namenode in Safemode reports to Simon non-zero number of deleted files during startup

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.20.3, 0.21.0, 0.22.0
    • Fix Version/s: 0.20.3
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      With this incompatible change, under metrics context "dfs", the record name "FSDirectory" is no longer available. The metrics "files_deleted" from the deleted record "FSDirectory" is now available in metrics context "dfs", record name "namenode" with the metrics name "FilesDeleted".
      Show
      With this incompatible change, under metrics context "dfs", the record name "FSDirectory" is no longer available. The metrics "files_deleted" from the deleted record "FSDirectory" is now available in metrics context "dfs", record name "namenode" with the metrics name "FilesDeleted".

      Description

      Currently when a namenode starts up it may call "delete" when loading edits. But metrics file_deleted is collected and reported in FSDirectory where it does not and is not able to check if namenode is in safemode. So from the monitoring UI, we see non-zero number of files deleted.

      A possible fix is to have delete to return the number of files deleted and then the metrics is collected and reported at NameNode the same as other namenode metrics.

      1. HDFS-132-0.20.patch
        13 kB
        Konstantin Shvachko
      2. HDFS-132.y20.patch
        14 kB
        Konstantin Shvachko
      3. HDFS-132.patch
        14 kB
        Suresh Srinivas
      4. HDFS-132.2.patch
        16 kB
        Suresh Srinivas
      5. HDFS-132.1.patch
        16 kB
        Suresh Srinivas

        Issue Links

          Activity

            People

            • Assignee:
              Suresh Srinivas
              Reporter:
              Hairong Kuang
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development