Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-265 Revisit append
  3. HDFS-636

SafeMode should count only complete blocks.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Append Branch
    • Append Branch
    • namenode
    • None
    • Incompatible change
    • SafeMode counts only complete blocks instead of all blocks.

    Description

      During start up the name-node is in safe mode and is counting blocks reported by data-nodes. When the number of minimally replicated blocks reaches the configured threshold the name-node leaves safe mode. Currently all blocks are counted towards the threshold including the ones that are under construction. The under-construction blocks should be excluded from the count, because they need to be recovered, which may take long time (lease expires in 1 hour by default). Also the recovery may result in deleting those blocks so counting them in the blocks total is incorrect.

      Attachments

        1. completeBlockTotal.patch
          7 kB
          Konstantin Shvachko

        Activity

          People

            shv Konstantin Shvachko
            shv Konstantin Shvachko
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: