[HADOOP-6870] Add FileSystem#listLocatedStatus to list a directory's content together with each file's block locations - ASF JIRA

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 0.22.0
Fix Version/s: 0.22.0
Component/s: fs
Labels:
None

Hadoop Flags:

Reviewed

Description

This jira implements the new FileSystem API as proposed in ~~HDFS-202~~. The new API aims to eliminate individual "getFileBlockLocations" calls to NN for each file in the input directory of a job. Instead, a file's block locations are returned together with FileStatus when listing a directory, thus improving getSplits performance.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

listFiles.patch
21/Jul/10 22:29
17 kB
Hairong Kuang
listFiles1.patch
24/Jul/10 00:44
19 kB
Hairong Kuang
listFiles2.patch
26/Jul/10 22:00
19 kB
Hairong Kuang
listFiles3.patch
27/Jul/10 00:36
21 kB
Hairong Kuang
listFiles4.patch
27/Jul/10 06:14
22 kB
Hairong Kuang

Issue Links

is related to

HDFS-202 Add a bulk FIleSystem.getFileBlockLocations

Closed

relates to

HADOOP-6900 FileSystem#listLocatedStatus should not throw generic RuntimeException to indicate error conditions

Closed

HADOOP-6890 Improve listFiles API introduced by HADOOP-6870

Closed

Activity

People

Assignee:: Hairong Kuang

Reporter:: Hairong Kuang

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 21/Jul/10 21:53

Updated:: 12/Dec/11 06:18

Resolved:: 29/Jul/10 00:16