[HADOOP-2285] TextInputFormat is slow compared to reading files. - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 0.15.0
Fix Version/s: 0.16.0
Component/s: None
Labels:
None

Description

The LineRecordReader reads from the source byte by byte, which seems to be half as fast as if the readLine method was defined on the memory buffer directly instead of as an InputStream.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

fast-line.patch
27/Dec/07 00:18
15 kB
Owen O'Malley
fast-line2.patch
08/Jan/08 09:28
16 kB
Arun Murthy
fast-line3.patch
08/Jan/08 20:25
16 kB
Christopher Douglas

Activity

People

Assignee:: Owen O'Malley

Reporter:: Owen O'Malley

Votes:: 3 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 26/Nov/07 22:44

Updated:: 08/Jul/09 16:52

Resolved:: 08/Jan/08 23:30