[PIG-3505] Make AvroStorage sync interval take default from io.file.buffer.size - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 0.11
Fix Version/s: 0.13.0
Component/s: None
Labels:
None

Description

The default sync interval is 16K which is very bad for bzip compression which can take bigger chunk of data for compression. Hadoop's Bzip2code uses io.file.buffer.size as the buffer size. Most tuned environments have it set to 128K which gives better compression.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

PIG-3505-1.patch
08/Oct/13 00:15
4 kB
Rohini Palaniswamy

Activity

People

Assignee:: Rohini Palaniswamy

Reporter:: Rohini Palaniswamy

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 08/Oct/13 00:13

Updated:: 07/Jul/14 18:07

Resolved:: 12/Nov/13 20:29