[HIVE-2218] speedup addInputPaths - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.8.0
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

Speedup the addInputPaths for combined symlink inputformat, and added some other micro optimizations which also work for normal cases.

This can help reducing the start time of one query from 5 hours to less than 20 mins.

Attachments

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-2218.1.patch
14/Jun/11 17:33
10 kB
He Yongqiang
HIVE-2218.2.patch
15/Jun/11 20:54
3 kB
He Yongqiang
HIVE-2218.3.patch
15/Jun/11 21:18
3 kB
He Yongqiang

Activity

People

Assignee:: He Yongqiang

Reporter:: He Yongqiang

Votes:: 0 Vote for this issue

Watchers:: 0 Start watching this issue

Dates

Created:: 14/Jun/11 02:52

Updated:: 16/Dec/11 23:56

Resolved:: 16/Jun/11 17:07