Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-132

Namenode in Safemode reports to Simon non-zero number of deleted files during startup

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.20.3, 0.21.0, 0.22.0
    • 0.20.3
    • namenode
    • None
    • Incompatible change, Reviewed
    • Hide
      With this incompatible change, under metrics context "dfs", the record name "FSDirectory" is no longer available. The metrics "files_deleted" from the deleted record "FSDirectory" is now available in metrics context "dfs", record name "namenode" with the metrics name "FilesDeleted".
      Show
      With this incompatible change, under metrics context "dfs", the record name "FSDirectory" is no longer available. The metrics "files_deleted" from the deleted record "FSDirectory" is now available in metrics context "dfs", record name "namenode" with the metrics name "FilesDeleted".

    Description

      Currently when a namenode starts up it may call "delete" when loading edits. But metrics file_deleted is collected and reported in FSDirectory where it does not and is not able to check if namenode is in safemode. So from the monitoring UI, we see non-zero number of files deleted.

      A possible fix is to have delete to return the number of files deleted and then the metrics is collected and reported at NameNode the same as other namenode metrics.

      Attachments

        1. HDFS-132-0.20.patch
          13 kB
          Konstantin Shvachko
        2. HDFS-132.y20.patch
          14 kB
          Konstantin Shvachko
        3. HDFS-132.2.patch
          16 kB
          Suresh Srinivas
        4. HDFS-132.1.patch
          16 kB
          Suresh Srinivas
        5. HDFS-132.patch
          14 kB
          Suresh Srinivas

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sureshms Suresh Srinivas
            hairong Hairong Kuang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment