Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-132

Namenode in Safemode reports to Simon non-zero number of deleted files during startup

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.20.3, 0.21.0, 0.22.0
    • Fix Version/s: 0.20.3
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      With this incompatible change, under metrics context "dfs", the record name "FSDirectory" is no longer available. The metrics "files_deleted" from the deleted record "FSDirectory" is now available in metrics context "dfs", record name "namenode" with the metrics name "FilesDeleted".
      Show
      With this incompatible change, under metrics context "dfs", the record name "FSDirectory" is no longer available. The metrics "files_deleted" from the deleted record "FSDirectory" is now available in metrics context "dfs", record name "namenode" with the metrics name "FilesDeleted".

      Description

      Currently when a namenode starts up it may call "delete" when loading edits. But metrics file_deleted is collected and reported in FSDirectory where it does not and is not able to check if namenode is in safemode. So from the monitoring UI, we see non-zero number of files deleted.

      A possible fix is to have delete to return the number of files deleted and then the metrics is collected and reported at NameNode the same as other namenode metrics.

        Attachments

        1. HDFS-132-0.20.patch
          13 kB
          Konstantin Shvachko
        2. HDFS-132.y20.patch
          14 kB
          Konstantin Shvachko
        3. HDFS-132.patch
          14 kB
          Suresh Srinivas
        4. HDFS-132.2.patch
          16 kB
          Suresh Srinivas
        5. HDFS-132.1.patch
          16 kB
          Suresh Srinivas

          Issue Links

            Activity

              People

              • Assignee:
                sureshms Suresh Srinivas
                Reporter:
                hairong Hairong Kuang
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: