[#HDFS-483] Data transfer (aka pipeline) implementation cannot tolerate exceptions - ASF JIRA

Issue Details (XML | Word | Printable)

Key:	HDFS-483
Type:	Bug
Status:	Open
Priority:	Major
Assignee:	Unassigned
Reporter:	Tsz Wo (Nicholas), SZE
Votes:	0
Watchers:	5

Operations

If you were logged in you would be able to see more operations.

Hadoop HDFS

Data transfer (aka pipeline) implementation cannot tolerate exceptions

Created: 10/Jul/09 01:19 AM Updated: 19/Aug/09 09:31 PM

Return to search

Component/s:

data-node, hdfs client

Affects Version/s:

None

Fix Version/s:

None

Time Tracking:

Issue & Sub-Tasks

Issue Only

Not Specified

File Attachments:

	File Name	Date Attached	Attached By	Size
	h483_20090709.patch	2009-07-10 01:29 AM	Tsz Wo (Nicholas), SZE	15 kB
	h483_20090713.patch	2009-07-13 10:44 PM	Tsz Wo (Nicholas), SZE	18 kB
	h483_20090717.patch	2009-07-17 06:12 PM	Tsz Wo (Nicholas), SZE	17 kB
	h483_20090727.patch	2009-07-28 12:03 AM	Tsz Wo (Nicholas), SZE	17 kB
	h483_20090730.patch	2009-07-31 01:05 AM	Tsz Wo (Nicholas), SZE	20 kB
	h483_20090731.patch	2009-08-01 12:51 AM	Tsz Wo (Nicholas), SZE	24 kB
	h483_20090806.patch	2009-08-06 06:55 PM	Tsz Wo (Nicholas), SZE	27 kB
	h483_20090807.patch	2009-08-07 06:52 PM	Tsz Wo (Nicholas), SZE	32 kB
	h483_20090807b.patch	2009-08-08 12:59 AM	Tsz Wo (Nicholas), SZE	8 kB
	h483_20090810.patch	2009-08-10 11:40 PM	Tsz Wo (Nicholas), SZE	17 kB
	h483_20090818.patch	2009-08-18 06:57 PM	Tsz Wo (Nicholas), SZE	36 kB
	h483_20090819.patch	2009-08-19 06:26 PM	Tsz Wo (Nicholas), SZE	27 kB
	h483_20090819b.patch	2009-08-19 09:31 PM	Tsz Wo (Nicholas), SZE	31 kB

Issue Links:

Reference

This issue relates to:

HDFS-264 Better Datanode DiskOutOfSpaceException handling.

~~HDFS-451~~ Test DataTransferProtocol with fault injection

~~HDFS-542~~ Support fault injection tests in Hudson

This issue is related to:

~~HDFS-521~~ Create new tests for pipeline

~~HDFS-435~~ Add orthogonal fault injection mechanism/framework

Sub-Tasks:

All

Open

1.

Adding pipeline test 17-35

Open

Unassigned

Description

Data transfer was tested with simulated exceptions as below:

create files with dfs
write 1 byte
close file
open the same file
read the 1 byte and compare results

The file was closed successfully but we got an IOException(Could not get block locations...) when the file was reopened for reading.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Ascending order - Click to sort in descending order

No work has yet been logged on this issue.