[BEAM-4752] Import error in apache_beam.internal.pickler: "'module' object has no attribute 'dill'"

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Invalid
• Affects Version/s: 2.4.0
• Fix Version/s: 2.4.0
• Component/s: sdk-py-core
• Environment: CentOS Linux release 7.4.1708 ; Python 2.7.13
• Assignee: Ahmet Altay
• Reporter: Barry Hart
• Created: 10/Jul/18 18:36
• Updated: 24/Jul/20 20:12
• Resolved: 10/Jul/18 19:29

Description

I'm seeing the following error (stack trace below). I looked at the module structure of the dill library, and it does not have a dill submodule (although it does have a _dill submodule). I think the correct way to reference Pickler is simply dill.Pickler.

Traceback (most recent call last):
  File "script/beam_run_model.py", line 29, in <module>
    import apache_beam as beam
  File "/usr/local/pyenv/versions/2.7.13/lib/python2.7/site-packages/apache_beam/__init__.py", line 84, in <module>
    import apache_beam.internal.pickler
  File "/usr/local/pyenv/versions/2.7.13/lib/python2.7/site-packages/apache_beam/internal/pickler.py", line 107, in <module>
    dill.dill.Pickler.dispatch[type])
AttributeError: 'module' object has no attribute 'dill'

Oddly, I have successfully used Beam 2.4.0 in the past with this version of Dill.  ¯(ツ)/¯

Issue Links

• links to: GitHub Pull Request #5931
• links to: GitHub Pull Request #5946
• links to: GitHub Pull Request #5949