It would be great to support an avro container format deserializer in the spool directory source.
Add docs for Avro Serializer and describe how to make the Avro Deserializer work with the Avro Serializer
Use Avro schema hashes in Log4jAppender and the HDFS Sink
Unit test is currently failing, but here is some partial progress on this feature.
Unit test now passes.
Updated avro deserializer with literal mode to be compatible with literal mode in the avro serializer.
This looks good to me. Is it worth pointing out the connection with the Avro event serializer in the docs? Also, if you use schema hashes there's (currently) no way to retrieve the schema.
Hmm, I think we should do that in a follow-up doc JIRA because we haven't documented the new AvroEventSerializer at all. I also don't think we have provided an alias for it yet.
+1. This looks good. Can you please file the doc jira, Mike?
Patch committed, rev: ad68350. Thanks Mike!
Integrated in flume-trunk #430 (See https://builds.apache.org/job/flume-trunk/430/)
FLUME-2048. Add an Avro container file deserializer for Spool Directory Source. (Revision ad68350ffcc9a6cb47b7b555b9ebf6dacfa7c129)
Result = SUCCESS
hshreedharan : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=ad68350ffcc9a6cb47b7b555b9ebf6dacfa7c129