Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14208

A large number missingblocks happend after failover to active.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 3.0.2, 3.1.1, 3.0.3
    • Fix Version/s: None
    • Component/s: hdfs
    • Labels:
      None

      Description

      When cluster is very large, Standby startup takes about 1 hours. After Standby starts and exits SafeMode, a large number of missingblocks often appeared after failover from standby to active. And the missingblocks will  gradually disappear after 6 hours(block report interval).

      According the log and find only half the blocks of one DataNode be processed in SaftMode.

       

      Because the lease expired after processed some blocks of one DataNode.

      MergeRequest

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                xuzq_zander xuzq
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: