[FLUME-2942] AvroEventDeserializer ignores header from spool source

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.6.0
• Fix Version/s: 1.8.1
• Assignee: Unassigned
• Reporter: Sebastian Alfers
• Created: 30/Jun/16 14:43
• Updated: 12/Sep/17 13:39

Description

I have a spool file source and use avro for de-/serialization

In detail, serialized events store the topic of the kafka sink in the header.

When I load the events from the spool directory, the header are ignored.

Please see: https://github.com/apache/flume/blob/caa64a1a6d4bc97be5993cb468516e9ffe862794/flume-ng-core/src/main/java/org/apache/flume/serialization/AvroEventDeserializer.java#L122

You can see, it uses the whole event as body but does not distinguish between the header and body encoded by avro.

Please verify that this is a bug.

I fixed this but by using the record that stores header and body separately.

Issue Links

• links to: GitHub Pull Request #99