It would be great to support an avro container format deserializer in the spool directory source.
Add docs for Avro Serializer and describe how to make the Avro Deserializer work with the Avro Serializer
Use Avro schema hashes in Log4jAppender and the HDFS Sink
Integrated in flume-trunk #430 (See https://builds.apache.org/job/flume-trunk/430/)
FLUME-2048. Add an Avro container file deserializer for Spool Directory Source. (Revision ad68350ffcc9a6cb47b7b555b9ebf6dacfa7c129)
Result = SUCCESS
hshreedharan : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=ad68350ffcc9a6cb47b7b555b9ebf6dacfa7c129
Patch committed, rev: ad68350. Thanks Mike!
+1. This looks good. Can you please file the doc jira, Mike?
Hmm, I think we should do that in a follow-up doc JIRA because we haven't documented the new AvroEventSerializer at all. I also don't think we have provided an alias for it yet.
This looks good to me. Is it worth pointing out the connection with the Avro event serializer in the docs? Also, if you use schema hashes there's (currently) no way to retrieve the schema.
Updated avro deserializer with literal mode to be compatible with literal mode in the avro serializer.
Unit test now passes.
Unit test is currently failing, but here is some partial progress on this feature.