Issue Details (XML | Word | Printable)

Key: HADOOP-3310
Type: New Feature New Feature
Status: Closed Closed
Resolution: Fixed
Priority: Major Major
Assignee: Tsz Wo (Nicholas), SZE
Reporter: Tsz Wo (Nicholas), SZE
Votes: 0
Watchers: 1
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

Lease recovery for append

Created: 24/Apr/08 11:43 PM   Updated: 08/Jul/09 04:43 PM
Return to search
Component/s: None
Affects Version/s: None
Fix Version/s: 0.18.0

Time Tracking:
Not Specified

File Attachments:
  Size
Text File Licensed for inclusion in ASF works 3310_20080514.patch 2008-05-14 05:25 PM Tsz Wo (Nicholas), SZE 38 kB
Text File Licensed for inclusion in ASF works 3310_20080516b.patch 2008-05-16 10:38 PM Tsz Wo (Nicholas), SZE 49 kB
Text File Licensed for inclusion in ASF works 3310_20080516c.patch 2008-05-16 10:55 PM Tsz Wo (Nicholas), SZE 47 kB
Text File Licensed for inclusion in ASF works 3310_20080519.patch 2008-05-19 08:49 PM Tsz Wo (Nicholas), SZE 51 kB
Text File Licensed for inclusion in ASF works 3310_20080519b.patch 2008-05-20 12:52 AM Tsz Wo (Nicholas), SZE 62 kB
Text File Licensed for inclusion in ASF works 3310_20080520.patch 2008-05-21 01:21 AM Tsz Wo (Nicholas), SZE 76 kB
Text File Licensed for inclusion in ASF works 3310_20080521.patch 2008-05-21 07:19 PM Tsz Wo (Nicholas), SZE 78 kB
Text File Licensed for inclusion in ASF works 3310_20080522b.patch 2008-05-22 09:20 PM Tsz Wo (Nicholas), SZE 81 kB
Text File Licensed for inclusion in ASF works 3310_20080522c.patch 2008-05-22 10:13 PM Tsz Wo (Nicholas), SZE 82 kB
Text File Licensed for inclusion in ASF works 3310_20080523.patch 2008-05-24 02:15 AM Tsz Wo (Nicholas), SZE 85 kB
Text File Licensed for inclusion in ASF works 3310_20080524_dhruba.patch 2008-05-24 09:22 AM dhruba borthakur 88 kB
Text File Licensed for inclusion in ASF works 3310_20080527.patch 2008-05-28 01:10 AM Tsz Wo (Nicholas), SZE 100 kB
Text File Licensed for inclusion in ASF works 3310_20080528.patch 2008-05-28 08:21 PM Tsz Wo (Nicholas), SZE 102 kB
Text File Licensed for inclusion in ASF works 3310_20080528b.patch 2008-05-28 09:54 PM Tsz Wo (Nicholas), SZE 101 kB
Text File Licensed for inclusion in ASF works 3310_20080528c.patch 2008-05-29 12:50 AM Tsz Wo (Nicholas), SZE 104 kB
Text File Licensed for inclusion in ASF works 3310_20080529.patch 2008-05-29 08:00 AM dhruba borthakur 96 kB
Text File Licensed for inclusion in ASF works 3310_20080529b.patch 2008-05-29 06:19 PM dhruba borthakur 105 kB
Text File Licensed for inclusion in ASF works 3310_20080529c.patch 2008-05-29 10:07 PM Tsz Wo (Nicholas), SZE 108 kB
Issue Links:
Blocker
Dependants
 

Hadoop Flags: Reviewed, Incompatible change
Release Note: Implemented Lease Recovery to sync the last bock of a file. Added ClientDatanodeProtocol for client trigging block recovery. Changed DatanodeProtocol to support block synchronization. Changed InterDatanodeProtocol to support block update.
Resolution Date: 02/Jun/08 06:46 PM


 Description  « Hide
In order to support file append, a GenerationStamp is associated with each block. Lease recovery will be performed when there is a possibility that the replicas of a block in a lease may have different GenerationStamp values.

For more details, see the documentation in HADOOP-1700.



 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Tsz Wo (Nicholas), SZE made changes - 25/Apr/08 12:03 AM
Field Original Value New Value
Link This issue blocks HADOOP-1700 [ HADOOP-1700 ]
Tsz Wo (Nicholas), SZE made changes - 05/May/08 10:16 PM
Assignee Tsz Wo (Nicholas), SZE [ szetszwo ]
dhruba borthakur made changes - 12/May/08 04:32 AM
Link This issue blocks HADOOP-3113 [ HADOOP-3113 ]
Tsz Wo (Nicholas), SZE made changes - 14/May/08 05:25 PM
Attachment 3310_20080514.patch [ 12382059 ]
Tsz Wo (Nicholas), SZE made changes - 16/May/08 10:38 PM
Attachment 3310_20080516b.patch [ 12382224 ]
Tsz Wo (Nicholas), SZE made changes - 16/May/08 10:55 PM
Attachment 3310_20080516c.patch [ 12382227 ]
Tsz Wo (Nicholas), SZE made changes - 19/May/08 08:49 PM
Attachment 3310_20080519.patch [ 12382332 ]
Tsz Wo (Nicholas), SZE made changes - 20/May/08 12:14 AM
Link This issue is blocked by HADOOP-3375 [ HADOOP-3375 ]
Tsz Wo (Nicholas), SZE made changes - 20/May/08 12:52 AM
Attachment 3310_20080519b.patch [ 12382339 ]
Tsz Wo (Nicholas), SZE made changes - 21/May/08 01:21 AM
Attachment 3310_20080520.patch [ 12382426 ]
Tsz Wo (Nicholas), SZE made changes - 21/May/08 07:19 PM
Attachment 3310_20080521.patch [ 12382503 ]
Tsz Wo (Nicholas), SZE made changes - 22/May/08 09:20 PM
Attachment 3310_20080522b.patch [ 12382600 ]
Tsz Wo (Nicholas), SZE made changes - 22/May/08 10:13 PM
Attachment 3310_20080522c.patch [ 12382608 ]
Tsz Wo (Nicholas), SZE made changes - 24/May/08 02:15 AM
Attachment 3310_20080523.patch [ 12382708 ]
dhruba borthakur made changes - 24/May/08 09:22 AM
Attachment 3310_20080524_dhruba.patch [ 12382713 ]
Tsz Wo (Nicholas), SZE made changes - 28/May/08 01:10 AM
Attachment 3310_20080527.patch [ 12382894 ]
Tsz Wo (Nicholas), SZE made changes - 28/May/08 08:21 PM
Attachment 3310_20080528.patch [ 12382961 ]
Tsz Wo (Nicholas), SZE made changes - 28/May/08 09:54 PM
Attachment 3310_20080528b.patch [ 12382974 ]
Tsz Wo (Nicholas), SZE made changes - 29/May/08 12:50 AM
Attachment 3310_20080528c.patch [ 12382989 ]
Tsz Wo (Nicholas), SZE made changes - 29/May/08 02:38 AM
Hadoop Flags [Incompatible change]
Status Open [ 1 ] Patch Available [ 10002 ]
dhruba borthakur made changes - 29/May/08 08:00 AM
Attachment 3310_20080529.patch [ 12383000 ]
dhruba borthakur made changes - 29/May/08 06:19 PM
Attachment 3310_20080529b.patch [ 12383040 ]
Tsz Wo (Nicholas), SZE made changes - 29/May/08 08:17 PM
Status Patch Available [ 10002 ] Open [ 1 ]
Tsz Wo (Nicholas), SZE made changes - 29/May/08 08:17 PM
Status Open [ 1 ] Patch Available [ 10002 ]
Tsz Wo (Nicholas), SZE made changes - 29/May/08 10:07 PM
Attachment 3310_20080529c.patch [ 12383056 ]
Tsz Wo (Nicholas), SZE made changes - 29/May/08 10:08 PM
Status Patch Available [ 10002 ] Open [ 1 ]
Tsz Wo (Nicholas), SZE made changes - 29/May/08 10:09 PM
Status Open [ 1 ] Patch Available [ 10002 ]
dhruba borthakur made changes - 02/Jun/08 06:45 PM
Hadoop Flags [Incompatible change] [Incompatible change, Reviewed]
dhruba borthakur made changes - 02/Jun/08 06:46 PM
Fix Version/s 0.18.0 [ 12312972 ]
Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
Resolution Fixed [ 1 ]
Status Patch Available [ 10002 ] Resolved [ 5 ]
Tsz Wo (Nicholas), SZE made changes - 02/Jun/08 07:08 PM
Release Note Implemented Lease Recovery for synchronized the last bock of a file lease. We have
- Added ClientDatanodeProtocol for client trigging block recovery
- Changed DatanodeProtocol to support block synchronization
- Changed InterDatanodeProtocol to support block update
Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
Robert Chansler made changes - 30/Jun/08 09:56 PM
Release Note Implemented Lease Recovery for synchronized the last bock of a file lease. We have
- Added ClientDatanodeProtocol for client trigging block recovery
- Changed DatanodeProtocol to support block synchronization
- Changed InterDatanodeProtocol to support block update
Implemented Lease Recovery to sync the last bock of a file. Added ClientDatanodeProtocol for client trigging block recovery. Changed DatanodeProtocol to support block synchronization. Changed InterDatanodeProtocol to support block update.
Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
Nigel Daley made changes - 22/Aug/08 07:50 PM
Status Resolved [ 5 ] Closed [ 6 ]
Owen O'Malley made changes - 08/Jul/09 04:43 PM
Component/s dfs [ 12310710 ]