Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7993

Provide each Replica details in fsck

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.6.0
    • 2.8.0, 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      When you run fsck with "-files" or "-racks", you will get something like below if one of the replicas is decommissioned.

      blk_x len=y repl=3 [dn1, dn2, dn3, dn4]
      

      That is because in NamenodeFsck, the repl count comes from live replicas count; while the actual nodes come from LocatedBlock which include decommissioned nodes.

      Another issue in NamenodeFsck is BlockPlacementPolicy's verifyBlockPlacement verifies LocatedBlock that includes decommissioned nodes. However, it seems better to exclude the decommissioned nodes in the verification; just like how fsck excludes decommissioned nodes when it check for under replicated blocks.

      Attachments

        1. HDFS-7993.1.patch
          7 kB
          J.Andreina
        2. HDFS-7993.2.patch
          7 kB
          J.Andreina
        3. HDFS-7993.3.patch
          7 kB
          J.Andreina
        4. HDFS-7993.4.patch
          9 kB
          J.Andreina
        5. HDFS-7993.5.patch
          12 kB
          J.Andreina
        6. HDFS-7993.6.patch
          13 kB
          J.Andreina

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            andreina J.Andreina
            mingma Ming Ma
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment