[AVRO-1243] Avro support for all compression codecs

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.7.3
• Fix Version/s: 1.7.4
• Component/s: java
• Release Note: This should have no incompatible changes. The only thing is files saved with the BZip2 codec will not be readable from earlier versions of Avro.
• Assignee: Theodore michael Malaska
• Reporter: Theodore michael Malaska
• Created: 07/Feb/13 12:22
• Updated: 27/Feb/13 00:54
• Resolved: 12/Feb/13 23:23

Description

I may be reading this wrong but at this time org.apache.avro.file.CodecFactory only supports null, deflate, and snappy compression codecs.

I would like to change the fromString method to use Class.forName(codec).newInstance(); after the codec was not found in the REGISTERED map but before the AvroRuntimeException is thrown.

Here are some of my supporting thoughts
1. This should not interduce much slowness because it will only be called initialize.
2. This will allow for support for GZip, BZip2, and LZO with out adding more dependances to the maven pom file.
3. This will allow for a future Jiri I would like to do that would allow AvroOutputFormat to be able to use the following configs: mapred.output.compress and mapred.output.compression.codec