[HBASE-26959] Brotli compression support

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.5.0, 3.0.0-alpha-3
• Hadoop Flags: Reviewed
• Assignee: Andrew Kyle Purtell
• Reporter: Andrew Kyle Purtell
• Created: 17/Apr/22 23:27
• Updated: 20/Mar/23 16:18
• Resolved: 22/Apr/22 23:52

Description

I was about to document the compression improvements upcoming in 2.5.0 and realized we lacked support for one of the major compression formats in use today. (Arguably brotli is not often used to compress data at rest, but is widely supported among web browsers and HTTP servers and clients.)

Brotli support for Java is provided by Apache 2 licensed Brotli4j available in Maven central.

It is not difficult to add it, so let's add it. There might be some advantage to opting for brotli compression when storing web data given the precomputed static dictionary of such content included in its specification.

Issue Links

• is related to: HBASE-26330 Document new provided compression codecs
• is related to: HBASE-26259 Fallback support to pure Java compression
• is related to: HBASE-26258 Universal compression support
• is related to: HBASE-27737 Add supplemental model for com.aayushatharva.brotli4j:native-osx-aarch64
• links to: GitHub Pull Request #4353