[BEAM-3040] Python precommit timed out after 150 minutes

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Won't Fix
• Fix Version/s: Not applicable
• Component/s: sdk-py-core
• Assignee: Ahmet Altay
• Reporter: Kenneth Knowles
• Created: 10/Oct/17 16:31
• Updated: 16/May/20 13:32
• Resolved: 22/May/19 00:53

Description

https://builds.apache.org/job/beam_PreCommit_Python_MavenInstall/143/consoleFull

Within about 10 minutes it reaches this point:

...
2017-10-10T03:33:33.591 [INFO] --- findbugs-maven-plugin:3.0.4:check (default) @ beam-sdks-python ---
2017-10-10T03:33:33.702 [INFO] 
2017-10-10T03:33:33.702 [INFO] --- exec-maven-plugin:1.5.0:exec (setuptools-test) @ beam-sdks-python ---

and the final output is like this:

...
2017-10-10T03:33:33.702 [INFO] --- exec-maven-plugin:1.5.0:exec (setuptools-test) @ beam-sdks-python ---
docs create: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/target/.tox/docs
GLOB sdist-make: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/setup.py
lint create: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/target/.tox/lint
py27 create: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/target/.tox/py27
py27cython create: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/target/.tox/py27cython
py27cython installdeps: nose==1.3.7, grpcio-tools==1.3.5, cython==0.25.2
docs installdeps: nose==1.3.7, grpcio-tools==1.3.5, Sphinx==1.5.5, sphinx_rtd_theme==0.2.4
lint installdeps: nose==1.3.7, pycodestyle==2.3.1, pylint==1.7.1
py27 installdeps: nose==1.3.7, grpcio-tools==1.3.5
lint inst: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/target/.tox/dist/apache-beam-2.3.0.dev.zip
py27 inst: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/target/.tox/dist/apache-beam-2.3.0.dev.zip
py27cython inst: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/target/.tox/dist/apache-beam-2.3.0.dev.zip
py27 runtests: PYTHONHASHSEED='2225684666'
py27 runtests: commands[0] | python --version
py27 runtests: commands[1] | - find apache_beam -type f -name *.pyc -delete
py27 runtests: commands[2] | pip install -e .[test]
lint runtests: PYTHONHASHSEED='2225684666'
lint runtests: commands[0] | time pip install -e .[test]
docs inst: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/target/.tox/dist/apache-beam-2.3.0.dev.zip
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
lint runtests: commands[1] | time /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/run_pylint.sh
py27 runtests: commands[4] | python setup.py test
docs runtests: PYTHONHASHSEED='2225684666'
docs runtests: commands[0] | time pip install -e .[test,gcp,docs]
docs runtests: commands[1] | time /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/generate_pydoc.sh
py27gcp create: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/target/.tox/py27gcp
py27gcp installdeps: nose==1.3.7
py27cython runtests: PYTHONHASHSEED='2225684666'
py27cython runtests: commands[0] | python --version
py27cython runtests: commands[1] | - find apache_beam -type f -name *.pyc -delete
py27cython runtests: commands[2] | - find apache_beam -type f -name *.c -delete
py27cython runtests: commands[3] | - find apache_beam -type f -name *.so -delete
py27cython runtests: commands[4] | - find target/build -type f -name *.c -delete
py27cython runtests: commands[5] | - find target/build -type f -name *.so -delete
py27cython runtests: commands[6] | time pip install -e .[test]
py27gcp inst: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_MavenInstall/sdks/python/target/.tox/dist/apache-beam-2.3.0.dev.zip
py27gcp runtests: PYTHONHASHSEED='2225684666'
py27gcp runtests: commands[0] | pip install -e .[test,gcp]
py27gcp runtests: commands[1] | python --version
py27gcp runtests: commands[2] | - find apache_beam -type f -name *.pyc -delete
py27gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
py27gcp runtests: commands[4] | python setup.py test
py27cython runtests: commands[7] | python apache_beam/examples/complete/autocomplete_test.py
py27cython runtests: commands[8] | python setup.py test
py27cython runtests: commands[9] | - find apache_beam -type f -name *.c -delete
py27cython runtests: commands[10] | - find apache_beam -type f -name *.so -delete
py27cython runtests: commands[11] | - find target/build -type f -name *.c -delete
py27cython runtests: commands[12] | - find target/build -type f -name *.so -delete
Build timed out (after 150 minutes). Marking the build as aborted.
Build was aborted
2017-10-10T05:49:52.726 [ERROR] Command execution failed.

Issue Links

• is duplicated by: BEAM-3053 apache_beam.runners.portability.universal_local_runner_test.UniversalLocalRunnerTest is flaky
• links to: GitHub Pull Request #3974
• links to: GitHub Pull Request #4099
• links to: GitHub Pull Request #4159