[AVRO-3380] Byte reading in avro.io does not assert read bytes to requested nbytes

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.0
• Fix Version/s: 1.11.1
• Component/s: python
• Labels: pull-request-available
• Assignee: Jarkko Jaakola
• Reporter: Jarkko Jaakola
• Created: 09/Feb/22 13:47
• Updated: 11/Feb/22 11:08
• Resolved: 11/Feb/22 11:06

Description

The Python 3 compatibility layer in version 1.10.0 asserted the number of read bytes to match the requested number.

In version 1.11.0 the read returns what is available and just progresses. This can be problem when having incompatible schemas or some other unexpected condition.

1.10.0 implementation: https://github.com/apache/avro/blob/release-1.10.0/lang/py3/avro/io.py#L158

1.11.0 implementation: https://github.com/apache/avro/blob/443614c12a15bb58fcf2487eb67ca6f885a68f96/lang/py/avro/io.py#L225

 

Issue Links

• links to: GitHub Pull Request #1529