[HDFS-8669] Erasure Coding: handle missing internal block locations in DFSStripedInputStream - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: HDFS-7285
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

Currently DFSStripedInputStream assumes we always have complete internal block location information, i.e., we can always get all the DataNodes for a striped block group. In a lot of scenarios the client cannot get complete block location info, e.g., some internal blocks are missing and the NameNode has not finished the recovery yet. We should add functionality to handle missing block locations in DFSStripedInputStream.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HDFS-8669-HDFS-7285.001.patch
13/Jul/15 08:38
45 kB
Walter Su
HDFS-8669.001.patch
07/Jul/15 23:34
45 kB
Jing Zhao
HDFS-8669.000.patch
25/Jun/15 22:32
38 kB
Jing Zhao

Issue Links

is duplicated by

HDFS-8732 Erasure Coding: Fail to read a file with corrupted blocks

Resolved

Activity

People

Assignee:: Jing Zhao

Reporter:: Jing Zhao

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 25/Jun/15 22:18

Updated:: 30/Sep/15 19:37

Resolved:: 13/Jul/15 18:45