[#HADOOP-3283] Need a mechanism for data nodes to update generation stamps.

Hadoop Common

Need a mechanism for data nodes to update generation stamps.

Created: 18/Apr/08 11:22 PM Updated: 22/Aug/08 07:50 PM

Return to search

Component/s:

None

Affects Version/s:

None

Fix Version/s:

0.18.0

Time Tracking:

Not Specified

File Attachments:

File Name	Date Attached	Attached By	Size
3283_20080423c.patch	2008-04-24 01:35 AM	Tsz Wo (Nicholas), SZE	23 kB
3283_20080424.patch	2008-04-24 11:30 PM	Tsz Wo (Nicholas), SZE	28 kB
3283_20080425versionID.patch	2008-04-25 09:19 PM	Tsz Wo (Nicholas), SZE	2 kB

Issue Links:

Dependants

This issue blocks:

~~HADOOP-1700~~ Append to files in HDFS

Reference

This issue is related to:

HDFS-282 Serialize ipcPort in DatanodeID instead of DatanodeRegistration and DatanodeInfo

Hadoop Flags:	Reviewed, Incompatible change
Release Note:	« Hide Added an IPC server in DataNode and a new IPC protocol InterDatanodeProtocol. Added conf properties dfs.datanode.ipc.address and dfs.datanode.handler.count with defaults "0.0.0.0:50020" and 3, respectively. Changed the serialization in DatanodeRegistration and DatanodeInfo, and therefore, updated the versionID in ClientProtocol, DatanodeProtocol, NamenodeProtocol. Show » Added an IPC server in DataNode and a new IPC protocol InterDatanodeProtocol. Added conf properties dfs.datanode.ipc.address and dfs.datanode.handler.count with defaults "0.0.0.0:50020" and 3, respectively. Changed the serialization in DatanodeRegistration and DatanodeInfo, and therefore, updated the versionID in ClientProtocol, DatanodeProtocol, NamenodeProtocol.
Resolution Date:	25/Apr/08 09:31 PM

Description

« Hide

For implementing file append feature (~~HADOOP-1700~~), a generation stamp is added to each block. We need a mechanism for data nodes to update generation stamps for lease recovery.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Tsz Wo (Nicholas), SZE made changes - 19/Apr/08 12:50 AM

Field	Original Value	New Value
Link		This issue blocks ~~HADOOP-1700~~ [ ~~HADOOP-1700~~ ]

Tsz Wo (Nicholas), SZE made changes - 23/Apr/08 11:12 PM

Assignee

Tsz Wo (Nicholas), SZE [ szetszwo ]

Tsz Wo (Nicholas), SZE made changes - 24/Apr/08 01:35 AM

Attachment

3283_20080423c.patch [ 12380811 ]

Tsz Wo (Nicholas), SZE made changes - 24/Apr/08 11:30 PM

Attachment

3283_20080424.patch [ 12380882 ]

Tsz Wo (Nicholas), SZE made changes - 24/Apr/08 11:31 PM

Status

Open [ 1 ]

Patch Available [ 10002 ]

dhruba borthakur made changes - 25/Apr/08 09:02 PM

Hadoop Flags

[Incompatible change, Reviewed]

Tsz Wo (Nicholas), SZE made changes - 25/Apr/08 09:19 PM

Attachment

3283_20080425versionID.patch [ 12380969 ]

Tsz Wo (Nicholas), SZE made changes - 25/Apr/08 09:26 PM

Release Note		Incompatible changes: - Added an IPC server in DataNode and a new IPC protocol InterDatanodeProtocol. Added conf properties dfs.datanode.ipc.address and dfs.datanode.handler.count with defaults "0.0.0.0:50020" and 3, respectively. - Changed the serialization in DatanodeRegistration and DatanodeInfo, and therefore, updated the versionID in ClientProtocol, DatanodeProtocol, NamenodeProtocol.
Hadoop Flags	[Reviewed, Incompatible change]	[Incompatible change, Reviewed]

dhruba borthakur made changes - 25/Apr/08 09:31 PM

Resolution		Fixed [ 1 ]
Hadoop Flags	[Reviewed, Incompatible change]	[Incompatible change, Reviewed]
Status	Patch Available [ 10002 ]	Resolved [ 5 ]

Tsz Wo (Nicholas), SZE made changes - 25/Apr/08 10:03 PM

Link

This issue is related to HADOOP-3316 [ HADOOP-3316 ]

Nigel Daley made changes - 09/May/08 10:28 PM

Fix Version/s

0.18.0 [ 12312972 ]

Robert Chansler made changes - 30/Jun/08 09:49 PM

Hadoop Flags	[Reviewed, Incompatible change]	[Incompatible change, Reviewed]
Release Note	Incompatible changes: - Added an IPC server in DataNode and a new IPC protocol InterDatanodeProtocol. Added conf properties dfs.datanode.ipc.address and dfs.datanode.handler.count with defaults "0.0.0.0:50020" and 3, respectively. - Changed the serialization in DatanodeRegistration and DatanodeInfo, and therefore, updated the versionID in ClientProtocol, DatanodeProtocol, NamenodeProtocol.	Added an IPC server in DataNode and a new IPC protocol InterDatanodeProtocol. Added conf properties dfs.datanode.ipc.address and dfs.datanode.handler.count with defaults "0.0.0.0:50020" and 3, respectively. Changed the serialization in DatanodeRegistration and DatanodeInfo, and therefore, updated the versionID in ClientProtocol, DatanodeProtocol, NamenodeProtocol.

Nigel Daley made changes - 22/Aug/08 07:50 PM

Status

Resolved [ 5 ]

Closed [ 6 ]