[AVRO-1364] Avro-C reader ignores final block in file

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.7.5
• Fix Version/s: 1.7.6
• Component/s: c
• Assignee: Unassigned
• Reporter: Ben Walsh
• Created: 21/Aug/13 13:28
• Updated: 23/Jan/14 21:58
• Resolved: 18/Dec/13 13:50

Description

The Avro-C reader can ignore the final block(s) in a file. It buffers the final block(s) to memory then detects EOF and returns. It doesn't finish reading from the buffer before returning EOF.

This bug was introduced in AVRO-1238 (https://issues.apache.org/jira/browse/AVRO-1238).

To reproduce:

cd avro/lang/c/tests

# copy file with 1 block
cp avro-1238-good.avro two-blocks.avro

# copy block to make file with 2 blocks
xxd -c1 -p avro-1238-good.avro | tail -22 | xxd -r -p >>two-blocks.avro

# should return 2*2 = 4 records:
../build/src/avrocat two-blocks.avro 
null
{"int": 100}

Issue Links

• is duplicated by: AVRO-1405 Avro-c may not handle eof correctly if avro data file contains multiple sync markers