[HIVE-17600] Make OrcFile's "enforceBufferSize" user-settable.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0, 3.0.0
• Fix Version/s: 2.2.1
• Component/s: ORC
• Labels: TODOC2.2
• Assignee: Mithun Radhakrishnan
• Reporter: Mithun Radhakrishnan
• Created: 25/Sep/17 21:25
• Updated: 05/Dec/17 08:48
• Resolved: 04/Dec/17 19:44

Description

This is a duplicate of ORC-238, but it applies to branch-2.2.

Compression buffer-sizes in OrcFile are computed at runtime, except when enforceBufferSize is set. The only snag here is that this flag can't be set by the user.
When runtime-computed buffer-sizes are not optimal (for some reason), the user has no way to work around it by setting a custom value.
I have a patch that we use at Yahoo.