[HIVE-13789] Repeatedly checking configuration in TextRecordWriter/Reader hurts performance - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Minor
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 2.1.0
Component/s: None
Labels:
None

Description

We check configuration to decide whether to escape certain characters each time write/read a record for custom scripts.
In our benchmark this becomes a hot spot method. And fixing it improves the execution of the custom script by 7% (3TB TPCx-BB dataset).

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-13789.1.patch
19/May/16 07:22
2 kB
Rui Li

Activity

People

Assignee:: Rui Li

Reporter:: Rui Li

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 19/May/16 07:16

Updated:: 21/Jun/16 15:08

Resolved:: 23/May/16 07:39