Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-265 Revisit append
  3. HDFS-644

Lease recovery, concurrency support.

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Lease recovery happens if hdfs client does not renew its leases within an hour. Lease recovery triggers block recovery if the block has not been completed during normal write or append operations. Name-node initiates such block recovery by sending BlockRecoveryCommand to data-nodes (via reply to a heartbeat). There could be a race condition if some data-nodes still recover the block when the name-node decides to start a new recovery because the previous one did not complete. This issue should take of the race condition by introducing recovery ids. It should also implement the new recovery protocol, which is described in the append design document,

        Attachments

        1. leaseRecovery.patch
          51 kB
          Konstantin Shvachko
        2. leaseRecovery.patch
          49 kB
          Konstantin Shvachko
        3. leaseRecovery.patch
          49 kB
          Konstantin Shvachko
        4. leaseRecovery.patch
          49 kB
          Konstantin Shvachko

          Activity

            People

            • Assignee:
              shv Konstantin Shvachko
              Reporter:
              shv Konstantin Shvachko
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: