Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-2768

Python Avro cannot be imported when packaged as a zip-file

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.9.2
    • Fix Version/s: 1.10.0
    • Component/s: python
    • Labels:
      None

      Description

      Hi,

      When running a Spark job I am packaging all Python dependencies in a zip-file which is distributed to the nodes. I am using AWS Glue to execute the Spark job.

      One of the dependencies included is the python package avro-python3. However, this cannot be used since VERSION.txt cannot be opened when the package is included as a zip. It errors out in _init_.py when trying to open the file. The file VERSION.txt is present, however the path given to open() looks something like "/home/user/custom-site-package.zip/avro/VERSION.txt".

      On a side note, the package has zip_safe set to true, so I expect this to work

      I have opened a PR on Github with a possible solution.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                calleo Carl Vander
              • Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: