[BEAM-7451] [beam_PerformanceTests_WordCountIT_Py27] [:sdks:python:test-suites:dataflow:py36:integrationTest] ModuleNotFoundError: No module named 'endpoints_pb2'

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Duplicate
• Fix Version/s: Not applicable
• Component/s: test-failures
• Labels: currently-failing flake flaky-test
• Assignee: Robert Bradshaw
• Reporter: Andrew Pilloud
• Created: 29/May/19 21:32
• Updated: 28/Jul/20 18:36
• Resolved: 17/Jun/19 18:42

Description

This is a flaky test, but is is failing 12 of the last 19 runs.

• [Jenkins Job|https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/54/console]

Initial investigation:

 

17:09:24 Failure: ModuleNotFoundError (No module named 'endpoints_pb2') ... ERROR
17:09:24 
17:09:24 ======================================================================
17:09:24 ERROR: Failure: ModuleNotFoundError (No module named 'endpoints_pb2')
17:09:24 ----------------------------------------------------------------------
17:09:24 Traceback (most recent call last):
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/nose/failure.py", line 39, in runTest
17:09:24     raise self.exc_val.with_traceback(self.tb)
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/nose/loader.py", line 418, in loadTestsFromName
17:09:24     addr.filename, addr.module)
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/nose/importer.py", line 47, in importFromPath
17:09:24     return self.importFromDir(dir_path, fqname)
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/nose/importer.py", line 94, in importFromDir
17:09:24     mod = load_module(part_fqname, fh, filename, desc)
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/build/gradleenv/-1734967053/lib/python3.6/imp.py", line 245, in load_module
17:09:24     return load_package(name, filename)
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/build/gradleenv/-1734967053/lib/python3.6/imp.py", line 217, in load_package
17:09:24     return _load(spec)
17:09:24   File "<frozen importlib._bootstrap>", line 684, in _load
17:09:24   File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
17:09:24   File "<frozen importlib._bootstrap_external>", line 678, in exec_module
17:09:24   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/sdks/python/apache_beam/__init__.py", line 97, in <module>
17:09:24     from apache_beam import coders
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/sdks/python/apache_beam/coders/__init__.py", line 19, in <module>
17:09:24     from apache_beam.coders.coders import *
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/sdks/python/apache_beam/coders/coders.py", line 32, in <module>
17:09:24     from apache_beam.coders import coder_impl
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/sdks/python/apache_beam/coders/coder_impl.py", line 44, in <module>
17:09:24     from apache_beam.utils import windowed_value
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/sdks/python/apache_beam/utils/windowed_value.py", line 34, in <module>
17:09:24     from apache_beam.utils.timestamp import MAX_TIMESTAMP
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/sdks/python/apache_beam/utils/timestamp.py", line 34, in <module>
17:09:24     from apache_beam.portability import common_urns
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/sdks/python/apache_beam/portability/common_urns.py", line 24, in <module>
17:09:24     from apache_beam.portability.api import beam_runner_api_pb2
17:09:24   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py", line 16, in <module>
17:09:24     import endpoints_pb2 as endpoints__pb2
17:09:24 ModuleNotFoundError: No module named 'endpoints_pb2'

Issue Links

• duplicates: BEAM-7527 Python 3 test parallelization causes test flakines due to ModuleNotFoundError.