Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10887

Provide admin/debug tool to dump block map

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • hdfs, namenode
    • None

    Description

      From time to time, when NN restarts, we see

      "The reported blocks X needs additional Y blocks to reach the threshold 0.9990 of total blocks Z. Safe mode will be turned off automatically.
      

      We'd wonder what these blocks that still need block reports are, and what DNs they could possibly be located, what happened to these DNs.

      This jira to to propose a new admin or debug tool to dump the block map info with the blocks that have fewer than minRepl replicas.

      Attachments

        1. HDFS-10887.001.patch
          21 kB
          Yongjun Zhang
        2. HDFS-10887.002.patch
          40 kB
          Yongjun Zhang

        Activity

          People

            yzhangal Yongjun Zhang
            yzhangal Yongjun Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated: