[BEAM-14342] testPairWithIndexWindowedTimestamped* failing on URL

• Type: Bug
• Status: Resolved
• Priority: P0
• Resolution: Fixed
• Fix Version/s: 2.39.0
• Component/s: runner-universal, test-failures
• Assignee: Yichi Zhang
• Reporter: Andrew Pilloud
• Created: 20/Apr/22 22:01
• Updated: 27/Apr/22 12:44
• Resolved: 21/Apr/22 22:31

Description

We've had hard failures in these tests:
org.apache.beam.sdk.transforms.SplittableDoFnTest.testPairWithIndexWindowedTimestampedBounded
org.apache.beam.sdk.transforms.SplittableDoFnTest.testPairWithIndexWindowedTimestampedUnbounded
since https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_ULR/2161/
then a good run, then failures back to https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_ULR/2150/

https://github.com/apache/beam/pull/16841 seems like a likely culprit...

java.lang.RuntimeException: The Runner experienced the following error during execution:
Traceback (most recent call last):
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/local_job_service.py", line 274, in _run_job
    result = self._invoke_runner()
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/local_job_service.py", line 292, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py", line 208, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py", line 408, in run_stages
    bundle_results = self._execute_bundle(
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py", line 809, in _execute_bundle
    runner_execution_context.queues.watermark_pending_inputs.enque(
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py", line 432, in enque
    existing_inputs.data[pcoll].extend(incoming_inputs.data[pcoll])
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py", line 155, in extend
    assert isinstance(extra, ListBuffer)
AssertionError

Issue Links

• links to: GitHub Pull Request #17420