[PARQUET-521] Add Brotli compression to Parquet

• Type: Wish
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.8.1

Environment

all

• Assignee: Ryan Blue
• Reporter: Martin W. Kirst
• Created: 10/Feb/16 23:32
• Updated: 23/Jun/24 03:28

Description

Hi,

Google release a new compression algorithm called Brotli.
A new compression algorithm for the internet, as they claim.
Currently Firefox and Chrome (both developer editions) already
support Brotli, as such as e.g. ngingx.
http://google-opensource.blogspot.de/2015/09/introducing-brotli-new-compression.html

I'm the author of jbrotli - the Java bindings for brotli.

I'm curios and doing a survey, if jBrotli is an option for parquet?
Feedback is welcome.

Thanks in advance
Martin

Issue Links

• is blocked by: PARQUET-609 Add Brotli compression to Parquet format
• is related to: HADOOP-13126 Add Brotli compression codec
• links to: PR #344