Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4752

Import error in apache_beam.internal.pickler: "'module' object has no attribute 'dill'"

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.4.0
    • Component/s: sdk-py-core
    • Labels:
      None
    • Environment:
      CentOS Linux release 7.4.1708
      Python 2.7.13

      Description

      I'm seeing the following error (stack trace below). I looked at the module structure of the dill library, and it does not have a dill submodule (although it does have a _dill submodule). I think the correct way to reference Pickler is simply dill.Pickler.

      Traceback (most recent call last):
        File "script/beam_run_model.py", line 29, in <module>
          import apache_beam as beam
        File "/usr/local/pyenv/versions/2.7.13/lib/python2.7/site-packages/apache_beam/__init__.py", line 84, in <module>
          import apache_beam.internal.pickler
        File "/usr/local/pyenv/versions/2.7.13/lib/python2.7/site-packages/apache_beam/internal/pickler.py", line 107, in <module>
          dill.dill.Pickler.dispatch[type])
      AttributeError: 'module' object has no attribute 'dill'

      Oddly, I have successfully used Beam 2.4.0 in the past with this version of Dill.  ¯(ツ)

        Attachments

          Activity

            People

            • Assignee:
              altay Ahmet Altay
              Reporter:
              barrywhart Barry Hart
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h 20m
                3h 20m