Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.18.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Implemented Lease Recovery to sync the last bock of a file. Added ClientDatanodeProtocol for client trigging block recovery. Changed DatanodeProtocol to support block synchronization. Changed InterDatanodeProtocol to support block update.

      Description

      In order to support file append, a GenerationStamp is associated with each block. Lease recovery will be performed when there is a possibility that the replicas of a block in a lease may have different GenerationStamp values.

      For more details, see the documentation in HADOOP-1700.

      1. 3310_20080514.patch
        38 kB
        Tsz Wo Nicholas Sze
      2. 3310_20080516b.patch
        49 kB
        Tsz Wo Nicholas Sze
      3. 3310_20080516c.patch
        47 kB
        Tsz Wo Nicholas Sze
      4. 3310_20080519.patch
        51 kB
        Tsz Wo Nicholas Sze
      5. 3310_20080519b.patch
        62 kB
        Tsz Wo Nicholas Sze
      6. 3310_20080520.patch
        76 kB
        Tsz Wo Nicholas Sze
      7. 3310_20080521.patch
        78 kB
        Tsz Wo Nicholas Sze
      8. 3310_20080522b.patch
        81 kB
        Tsz Wo Nicholas Sze
      9. 3310_20080522c.patch
        82 kB
        Tsz Wo Nicholas Sze
      10. 3310_20080523.patch
        85 kB
        Tsz Wo Nicholas Sze
      11. 3310_20080524_dhruba.patch
        88 kB
        dhruba borthakur
      12. 3310_20080527.patch
        100 kB
        Tsz Wo Nicholas Sze
      13. 3310_20080528.patch
        102 kB
        Tsz Wo Nicholas Sze
      14. 3310_20080528b.patch
        101 kB
        Tsz Wo Nicholas Sze
      15. 3310_20080528c.patch
        104 kB
        Tsz Wo Nicholas Sze
      16. 3310_20080529.patch
        96 kB
        dhruba borthakur
      17. 3310_20080529b.patch
        105 kB
        dhruba borthakur
      18. 3310_20080529c.patch
        108 kB
        Tsz Wo Nicholas Sze

        Issue Links

          Activity

          Gavin made changes -
          Link This issue is depended upon by HADOOP-1700 [ HADOOP-1700 ]
          Gavin made changes -
          Link This issue blocks HADOOP-1700 [ HADOOP-1700 ]
          Owen O'Malley made changes -
          Component/s dfs [ 12310710 ]
          Nigel Daley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Robert Chansler made changes -
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Release Note Implemented Lease Recovery for synchronized the last bock of a file lease. We have
          - Added ClientDatanodeProtocol for client trigging block recovery
          - Changed DatanodeProtocol to support block synchronization
          - Changed InterDatanodeProtocol to support block update
          Implemented Lease Recovery to sync the last bock of a file. Added ClientDatanodeProtocol for client trigging block recovery. Changed DatanodeProtocol to support block synchronization. Changed InterDatanodeProtocol to support block update.
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Release Note Implemented Lease Recovery for synchronized the last bock of a file lease. We have
          - Added ClientDatanodeProtocol for client trigging block recovery
          - Changed DatanodeProtocol to support block synchronization
          - Changed InterDatanodeProtocol to support block update
          dhruba borthakur made changes -
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Fix Version/s 0.18.0 [ 12312972 ]
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          dhruba borthakur made changes -
          Hadoop Flags [Incompatible change] [Incompatible change, Reviewed]
          Tsz Wo Nicholas Sze made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080529c.patch [ 12383056 ]
          Tsz Wo Nicholas Sze made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          dhruba borthakur made changes -
          Attachment 3310_20080529b.patch [ 12383040 ]
          dhruba borthakur made changes -
          Attachment 3310_20080529.patch [ 12383000 ]
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags [Incompatible change]
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080528c.patch [ 12382989 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080528b.patch [ 12382974 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080528.patch [ 12382961 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080527.patch [ 12382894 ]
          dhruba borthakur made changes -
          Attachment 3310_20080524_dhruba.patch [ 12382713 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080523.patch [ 12382708 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080522c.patch [ 12382608 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080522b.patch [ 12382600 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080521.patch [ 12382503 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080520.patch [ 12382426 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080519b.patch [ 12382339 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is blocked by HADOOP-3375 [ HADOOP-3375 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080519.patch [ 12382332 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080516c.patch [ 12382227 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080516b.patch [ 12382224 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 3310_20080514.patch [ 12382059 ]
          dhruba borthakur made changes -
          Link This issue blocks HADOOP-3113 [ HADOOP-3113 ]
          Tsz Wo Nicholas Sze made changes -
          Assignee Tsz Wo (Nicholas), SZE [ szetszwo ]
          Tsz Wo Nicholas Sze made changes -
          Field Original Value New Value
          Link This issue blocks HADOOP-1700 [ HADOOP-1700 ]
          Tsz Wo Nicholas Sze created issue -

            People

            • Assignee:
              Tsz Wo Nicholas Sze
              Reporter:
              Tsz Wo Nicholas Sze
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development