[BEAM-3874] Switch AvroIO sink default codec to Snappy

• Type: Improvement
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: 2.4.0
• Component/s: io-java-avro
• Assignee: Marian Dvorsky
• Reporter: Marian Dvorsky
• Created: 18/Mar/18 15:42
• Updated: 16/May/20 13:19
• Resolved: 27/Jan/19 21:47

Description

AvroIO currently uses CodecFactory.deflateCodec(6) as the default codec for writes.

That compresses well, but is quite expensive.

Snappy codec offers sparser, but much faster compression, and is typically a better CPU/storage tradeoff except for very long lived files. 

We should consider switching the default to Snappy.

Issue Links

• links to: GitHub Pull Request #4904