Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-11792

Python precommit failed (flaked?) installing package

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Triage Needed
    • Priority: P1
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: test-failures
    • Labels:

      Description

      https://ci-beam.apache.org/job/beam_PreCommit_Python_Commit/17240/

      Execution failed for task ':sdks:python:test-suites:dataflow:py36:preCommitIT_batch'.
      Execution failed for task ':sdks:python:test-suites:dataflow:py37:preCommitIT_batch'.

      ======================================================================
      ERROR: test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT)
      ----------------------------------------------------------------------
      Traceback (most recent call last):
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/examples/wordcount_it_test.py", line 53, in test_wordcount_it
      self._run_wordcount_it(wordcount.run)
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/examples/wordcount_it_test.py", line 107, in _run_wordcount_it
      save_main_session=False,
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/examples/wordcount.py", line 94, in run
      output | 'Write' >> WriteToText(known_args.output)
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/pipeline.py", line 580, in _exit_
      self.result = self.run()
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/pipeline.py", line 530, in run
      self._options).run(False)
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/pipeline.py", line 559, in run
      return self.runner.run_pipeline(self, self._options)
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py", line 57, in run_pipeline
      self).run_pipeline(pipeline, options)
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py", line 504, in run_pipeline
      artifacts=environments.python_sdk_dependencies(options)))
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/transforms/environments.py", line 742, in python_sdk_dependencies
      skip_prestaged_dependencies=skip_prestaged_dependencies))
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/runners/portability/stager.py", line 179, in create_job_resources
      setup_options.requirements_file, requirements_cache_path)
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/utils/retry.py", line 260, in wrapper
      return fun(*args, **kwargs)
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/runners/portability/stager.py", line 569, in _populate_requirements_cache
      processes.check_output(cmd_args, stderr=processes.STDOUT)
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/utils/processes.py", line 99, in check_output
      .format(traceback.format_exc(), args[0][6], error.output))
      RuntimeError: Full traceback: Traceback (most recent call last):
      File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/sdks/python/apache_beam/utils/processes.py", line 91, in check_output
      out = subprocess.check_output(*args, **kwargs)
      File "/usr/lib/python3.7/subprocess.py", line 395, in check_output
      **kwargs).stdout
      File "/usr/lib/python3.7/subprocess.py", line 487, in run
      output=stdout, stderr=stderr)
      subprocess.CalledProcessError: Command '['/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit/src/build/gradleenv/1734967052/bin/python', '-m', 'pip', 'download', '-dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requiremen
      ts.txt', '-exists-action', 'i', '-no-binary', ':all:']' returned non-zero exit status 1.

      Pip install failed for package: -r
      Output from execution of subprocess: b'Collecting pyhamcrest!=1.10.0,<2.0.0\n File was already downloaded /tmp/dataflow-requirements-cache/PyHamcrest-1.10.1.tar.gz\nERROR: Could not find a version that satisfies the requirement 0\nERROR: No matching d
      istribution found for 0\n'

        Attachments

          Activity

            People

            • Assignee:
              tvalentyn Valentyn Tymofieiev
              Reporter:
              ibzib Kyle Weaver
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: