[BEAM-10244] Populate requirements cache fails on poetry-based packages

• Type: Bug
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Fix Version/s: Missing
• Component/s: sdk-py-core
• Assignee: Unassigned
• Reporter: Udi Meiri
• Created: 11/Jun/20 18:15
• Updated: 13/Jan/22 21:48
• Resolved: 14/Oct/21 17:42

Description

Sample command to recreate:

pip download rsa==4.1 --no-binary :all:

Collecting rsa==4.1
  File was already downloaded /usr/local/google/home/ehudm/so_srcs/b158725078/rsa-4.1.tar.gz
  Installing build dependencies ... error
  ERROR: Command errored out with exit status 1:
   command: /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7 /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip install --ignore-installed --no-user --prefix /tmp/pip-build-env-l4iugm_b/overlay --no-warn-script-location --no-binary :all: --only-binary :none: -i https://pypi.org/simple -- 'poetry>=0.12'
       cwd: None
  Complete output (50 lines):
  Collecting poetry>=0.12
    Using cached https://files.pythonhosted.org/packages/65/76/3ce57248bc821634955ffd43eb58e7ea17ed5cf6c15f94059885cb1b6155/poetry-1.0.9.tar.gz
    Installing build dependencies: started
    Installing build dependencies: finished with status 'done'
    Getting requirements to build wheel: started
    Getting requirements to build wheel: finished with status 'error'
    ERROR: Command errored out with exit status 1:
     command: /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7 /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py get_requires_for_build_wheel /tmp/tmpqizpa3_5
         cwd: /tmp/pip-install-idj3pvty/poetry
    Complete output (36 lines):
    Traceback (most recent call last):
      File "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py", line 207, in <module>
        main()
      File "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py", line 197, in main
        json_out['return_val'] = hook(**hook_input['kwargs'])
      File "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py", line 54, in get_requires_for_build_wheel
        return hook(config_settings)
      File "/tmp/pip-build-env-igoypwpj/overlay/lib/python3.7/site-packages/intreehooks.py", line 53, in get_requires_for_build_wheel
        return self._backend.get_requires_for_build_sdist(config_settings)
      File "/tmp/pip-build-env-igoypwpj/overlay/lib/python3.7/site-packages/intreehooks.py", line 38, in _backend
        obj = self._module_from_dir(modname)
      File "/tmp/pip-build-env-igoypwpj/overlay/lib/python3.7/site-packages/intreehooks.py", line 25, in _module_from_dir
        mod = importlib.import_module(modname)
      File "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/lib/python3.7/importlib/__init__.py", line 127, in import_module
        return _bootstrap._gcd_import(name[level:], package, level)
      File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
      File "<frozen importlib._bootstrap>", line 983, in _find_and_load
      File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked
      File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
      File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
      File "<frozen importlib._bootstrap>", line 983, in _find_and_load
      File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
      File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
      File "<frozen importlib._bootstrap_external>", line 728, in exec_module
      File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
      File "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/__init__.py", line 10, in <module>
        from .builder import Builder
      File "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/builder.py", line 1, in <module>
        from .builders.complete import CompleteBuilder
      File "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/builders/__init__.py", line 1, in <module>
        from .complete import CompleteBuilder
      File "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/builders/complete.py", line 6, in <module>
        from poetry.factory import Factory
      File "/tmp/pip-install-idj3pvty/poetry/poetry/factory.py", line 10, in <module>
        from clikit.api.io.io import IO
    ModuleNotFoundError: No module named 'clikit'
    ----------------------------------------
  ERROR: Command errored out with exit status 1: /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7 /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py get_requires_for_build_wheel /tmp/tmpqizpa3_5 Check the logs for full command output.
  WARNING: You are using pip version 19.2.3, however version 20.1.1 is available.
  You should consider upgrading via the 'pip install --upgrade pip' command.
  ----------------------------------------
ERROR: Command errored out with exit status 1: /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7 /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip install --ignore-installed --no-user --prefix /tmp/pip-build-env-l4iugm_b/overlay --no-warn-script-location --no-binary :all: --only-binary :none: -i https://pypi.org/simple -- 'poetry>=0.12' Check the logs for full command output.
WARNING: You are using pip version 19.2.3, however version 20.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

Trying to download poetry directly also gives the same error.

Issue Links

• links to: GitHub Pull Request #12003