Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-132

Namenode in Safemode reports to Simon non-zero number of deleted files during startup

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.20.3, 0.21.0, 0.22.0
    • 0.20.3
    • namenode
    • None
    • Incompatible change, Reviewed
    • Hide
      With this incompatible change, under metrics context "dfs", the record name "FSDirectory" is no longer available. The metrics "files_deleted" from the deleted record "FSDirectory" is now available in metrics context "dfs", record name "namenode" with the metrics name "FilesDeleted".
      Show
      With this incompatible change, under metrics context "dfs", the record name "FSDirectory" is no longer available. The metrics "files_deleted" from the deleted record "FSDirectory" is now available in metrics context "dfs", record name "namenode" with the metrics name "FilesDeleted".

    Description

      Currently when a namenode starts up it may call "delete" when loading edits. But metrics file_deleted is collected and reported in FSDirectory where it does not and is not able to check if namenode is in safemode. So from the monitoring UI, we see non-zero number of files deleted.

      A possible fix is to have delete to return the number of files deleted and then the metrics is collected and reported at NameNode the same as other namenode metrics.

      Attachments

        1. HDFS-132-0.20.patch
          13 kB
          Konstantin Shvachko
        2. HDFS-132.y20.patch
          14 kB
          Konstantin Shvachko
        3. HDFS-132.2.patch
          16 kB
          Suresh Srinivas
        4. HDFS-132.1.patch
          16 kB
          Suresh Srinivas
        5. HDFS-132.patch
          14 kB
          Suresh Srinivas

        Issue Links

          Activity

            People

              sureshms Suresh Srinivas
              hairong Hairong Kuang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: