Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8793

installGcpTest task flakes (python setup.py egg_info fails)

Details

    • Improvement
    • Status: Resolved
    • P3
    • Resolution: Cannot Reproduce
    • None
    • Not applicable
    • test-failures
    • None

    Description

      This seems to affect the installGcpTest task for all python versions. There are a few different failure modes, but they look like they might be related.

      == 1 ==
      11:01:38 > Task :sdks:python:test-suites:direct:py35:installGcpTest FAILED
      11:01:38 Obtaining file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python
      11:01:38 ERROR: Command errored out with exit status 1:
      11:01:38 command: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/bin/python3.5 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"'; _file='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file_, '"'"'exec'"'"'))' egg_info
      11:01:38 cwd: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/
      11:01:38 Complete output (37 lines):
      11:01:38 Traceback (most recent call last):
      11:01:38 File "<string>", line 1, in <module>
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py", line 264, in <module>
      11:01:38 'test': generate_protos_first(test),
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/_init_.py", line 144, in setup
      11:01:38 _install_setup_requires(attrs)
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/_init_.py", line 139, in _install_setup_requires
      11:01:38 dist.fetch_build_eggs(dist.setup_requires)
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py", line 720, in fetch_build_eggs
      11:01:38 replace_conflicting=True,
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/_init_.py", line 782, in resolve
      11:01:38 replace_conflicting=replace_conflicting
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/_init_.py", line 1065, in best_match
      11:01:38 return self.obtain(req, installer)
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/_init_.py", line 1077, in obtain
      11:01:38 return installer(requirement)
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py", line 787, in fetch_build_egg
      11:01:38 return cmd.easy_install(req)
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", line 679, in easy_install
      11:01:38 return self.install_item(spec, dist.location, tmpdir, deps)
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", line 705, in install_item
      11:01:38 dists = self.install_eggs(spec, download, tmpdir)
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", line 855, in install_eggs
      11:01:38 return [self.install_wheel(dist_filename, tmpdir)]
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", line 1073, in install_wheel
      11:01:38 os.path.dirname(destination)
      11:01:38 File "/usr/lib/python3.5/distutils/cmd.py", line 336, in execute
      11:01:38 util.execute(func, args, msg, dry_run=self.dry_run)
      11:01:38 File "/usr/lib/python3.5/distutils/util.py", line 301, in execute
      11:01:38 func(*args)
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py", line 101, in install_as_egg
      11:01:38 self._install_as_egg(destination_eggdir, zf)
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py", line 109, in _install_as_egg
      11:01:38 self._convert_metadata(zf, destination_eggdir, dist_info, egg_info)
      11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py", line 154, in _convert_metadata
      11:01:38 os.rename(dist_info, egg_info)
      11:01:38 FileNotFoundError: [Errno 2] No such file or directory: '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/pytest_runner-5.2.dist-info' -> '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/EGG-INFO'
      11:01:38 ----------------------------------------
      11:01:38 ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

      Another error I saw was:

      == 2 ==
      12:35:25 > Task :sdks:python:test-suites:direct:py37:installGcpTest FAILED
      12:35:25 Obtaining file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python
      12:35:25 ERROR: Command errored out with exit status 1:
      12:35:25 command: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/bin/python3.7 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"'; _file='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file_, '"'"'exec'"'"'))' egg_info
      12:35:25 cwd: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/
      12:35:25 Complete output (29 lines):
      12:35:25 Traceback (most recent call last):
      12:35:25 File "<string>", line 1, in <module>
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py", line 259, in <module>
      12:35:25 'test': generate_protos_first(test),
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/_init_.py", line 144, in setup
      12:35:25 _install_setup_requires(attrs)
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/_init_.py", line 139, in _install_setup_requires
      12:35:25 dist.fetch_build_eggs(dist.setup_requires)
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py", line 720, in fetch_build_eggs
      12:35:25 replace_conflicting=True,
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/_init_.py", line 782, in resolve
      12:35:25 replace_conflicting=replace_conflicting
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/_init_.py", line 1065, in best_match
      12:35:25 return self.obtain(req, installer)
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/_init_.py", line 1077, in obtain
      12:35:25 return installer(requirement)
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py", line 787, in fetch_build_egg
      12:35:25 return cmd.easy_install(req)
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 679, in easy_install
      12:35:25 return self.install_item(spec, dist.location, tmpdir, deps)
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 705, in install_item
      12:35:25 dists = self.install_eggs(spec, download, tmpdir)
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 855, in install_eggs
      12:35:25 return [self.install_wheel(dist_filename, tmpdir)]
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 1079, in install_wheel
      12:35:25 return self.egg_distribution(destination)
      12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 897, in egg_distribution
      12:35:25 metadata = EggMetadata(zipimport.zipimporter(egg_path))
      12:35:25 zipimport.ZipImportError: not a Zip file
      12:35:25 ----------------------------------------
      12:35:25 ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

      == 3 ==
      07:56:50 > Task :sdks:python:test-suites:portable:py2:installGcpTest FAILED
      ...
      07:56:50 File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py", line 110, in _install_as_egg
      07:56:50 self._convert_metadata(zf, destination_eggdir, dist_info, egg_info)
      07:56:50 File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py", line 131, in _convert_metadata
      07:56:50 os.mkdir(destination_eggdir)
      07:56:50 OSError: [Errno 17] File exists: '/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/sdks/python/.eggs/pytest_runner-5.2-py2.7.egg'
      07:56:50 ----------------------------------------
      07:56:50 ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ibzib Kyle Weaver
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: