[HADOOP-12572] Update Hadoop's lz4 to r131

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: native
• Target Version/s: 2.8.3
• Hadoop Flags: Reviewed
• Flags: Patch
• Assignee: Kevin Bowling
• Reporter: Kevin Bowling
• Created: 14/Nov/15 10:22
• Updated: 09/Jul/20 10:07

Description

Update hadoop's native lz4 copy to r131 versus the current r123 copy. Release notes for the versions are at https://github.com/Cyan4973/lz4/releases

Noteworthy changes:

• 30% performance improvement for clang
• GCC 4.9+ bug fixes
• New 32/64 bits, little/big endian and strict/efficient align detection routines (internal)
• Small decompression speed improvement

This is my first Hadoop patch, review/feedback appreciated.

Issue Links

• breaks: HADOOP-1259 DFS should enforce block size is a multiple of io.bytes.per.checksum