Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1555

HDFS 20 append: Disallow pipeline recovery if a file is already being lease recovered

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20-append
    • 0.20-append, 0.20.205.0
    • None
    • None
    • Reviewed

    Description

      When a file is under lease recovery and the writer is still alive, the write pipeline will be killed and then the writer will start a pipeline recovery. Sometimes the pipeline recovery may race before the lease recovery and as a result fail the lease recovery. This is very bad if we want to support the strong recoverLease semantics in HDFS-1554. So it would be nice if we could disallow a file's pipeline recovery while its lease recovery is in progress.

      Attachments

        1. appendRecoveryRace.patch
          6 kB
          Hairong Kuang
        2. HDFS-1555.20-security.1.patch
          6 kB
          Jitendra Nath Pandey
        3. recoveryRace.patch
          4 kB
          Hairong Kuang

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-1554 Append 0.20: New semantics for recoverLease

          • Major - Major loss of function.
          • Closed
          relates to

          Task - A task that needs to be done. HDFS-1948 Forward port 'hdfs-1520 lightweight namenode operation to trigger lease reccovery'

          • Major - Major loss of function.
          • Closed

          Activity

            People

              hairong Hairong Kuang
              hairong Hairong Kuang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: