[HADOOP-16022] Increase Compression Buffer Sizes - Remove Magic Numbers

• Type: Improvement
• Status: Patch Available
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.10.0, 3.2.0
• Component/s: io
• Flags: Patch
• Assignee: David Mollitor
• Reporter: David Mollitor
• Created: 27/Dec/18 19:05
• Updated: 14/Jan/19 19:13

Description

Compression.java

    // data input buffer size to absorb small reads from application.
    private static final int DATA_IBUF_SIZE = 1 * 1024;
    // data output buffer size to absorb small writes from application.
    private static final int DATA_OBUF_SIZE = 4 * 1024;

There exists these hard coded buffer sizes in the Compression code. Instead, use the JVM default sizes, which, this day and age, are usually set for 8K.