[AVRO-2432] Python 3: AssertionError on reading "empty" file

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Fix Version/s: 1.10.0
• Component/s: python
• Assignee: Michael A. Smith
• Reporter: David Beswick
• Created: 19/Jun/19 23:41
• Updated: 02/Jul/20 12:23
• Resolved: 28/Oct/19 22:08

Description

I've seen this problem with the pip package avro-python3. An AssertionError is thrown on reading certain unusual files.

Problematic files seem to have these characteristics:

• The file is read without issue by avro-tools
• Normal, correct header with sync token
• Zero records (first block_count read is zero)
• A sync token follows the zero block_count long, then EOF

An example file is attached.

Repro code (nothing special):

from avro.datafile import DataFileReader
from avro.io import DatumReader

with DataFileReader(open("28.avro", 'rb'), DatumReader()) as r:
    for rec in r:
        print(rec)

Issue Links

• links to: GitHub Pull Request #691