[BEAM-10897] beam qualifies a fastavro version that does not work under windows + python 3.8

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Affects Version/s: 2.23.0
• Component/s: dependencies, sdk-py-core
• Assignee: Unassigned
• Reporter: Zhuo Peng
• Created: 15/Sep/20 04:23
• Updated: 24/Jan/22 17:05
• Resolved: 24/Jan/22 17:05

Description

Currently beam depends on

'fastavro>=0.21.4,<0.24'  [1]

 

However at least one fastavro version, 0.21.24 in that range does not work under windows + python3.8:

 

$ pip install 'fastavro==0.21.24'

$ python3.8 -c 'import fastavro'

Segmentation fault

 

I couldn't find an upstream issue (in fastavro). But the latest qualifying fastavro, 0.23.6 doesn't have this problem.

 

[1] https://github.com/apache/beam/blob/a2126e571cfddc90e3819e66ef1f2da3d52833ed/sdks/python/setup.py#L144

Issue Links

• links to: GitHub Pull Request #16553