[AVRO-1529] ConcatTool issue with empty files

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.7.6
• Component/s: java
• Assignee: Unassigned
• Reporter: Manuel Godbert
• Created: 20/Jun/14 15:16
• Updated: 28/Aug/15 08:40

Description

I am using the ConcatTool to merge 2 avro files. The first one is empty, the second one has records. The merged file is seen as empty when I am opening it.

My investigations showed the cause is that DataFileWriter.appendAllFrom(...) copies blocks from source to target even if they are empty, and DataFileReader.hasNext() returns false if the first block of an avro file is empty.