[AVRO-2768] Python Avro cannot be imported when packaged as a zip-file

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.2
• Fix Version/s: 1.10.0
• Component/s: python
• Assignee: Unassigned
• Reporter: Carl Vander
• Created: 02/Mar/20 16:28
• Updated: 19/Sep/20 15:46
• Resolved: 04/Aug/20 08:52

Description

Hi,

When running a Spark job I am packaging all Python dependencies in a zip-file which is distributed to the nodes. I am using AWS Glue to execute the Spark job.

One of the dependencies included is the python package avro-python3. However, this cannot be used since VERSION.txt cannot be opened when the package is included as a zip. It errors out in _init_.py when trying to open the file. The file VERSION.txt is present, however the path given to open() looks something like "/home/user/custom-site-package.zip/avro/VERSION.txt".

On a side note, the package has zip_safe set to true, so I expect this to work

I have opened a PR on Github with a possible solution.

Issue Links

• links to: GitHub Pull Request #838