[BEAM-11812] PostCommit Java VR ULR Failing

• Type: Bug
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: test-failures
• Labels: currently-failing
• Assignee: Yichi Zhang
• Reporter: Brian Hulette
• Created: 12/Feb/21 23:23
• Updated: 06/Mar/21 01:46
• Resolved: 06/Mar/21 01:43

Description

First failure: https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_ULR/534/

Failing org.apache.beam.sdk.transforms.ReshuffleTest.testReshuffleAfterSessionsAndGroupByKey

java.lang.RuntimeException: The Runner experienced the following error during execution:
Traceback (most recent call last):
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/local_job_service.py", line 275, in _run_job
    result = fn_runner.FnApiRunner(
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py", line 193, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py", line 356, in run_stages
    stage_results = self._run_stage(
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py", line 547, in _run_stage
    last_result, deferred_inputs, fired_timers = self._run_bundle(
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py", line 593, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py", line 886, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py", line 762, in _send_input_to_worker
    for byte_stream in byte_streams:
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py", line 254, in __iter__
    return itertools.chain(*self.partition(1))
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py", line 240, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/transforms/trigger.py", line 1126, in process_entire_key
    for wvalue in self.process_elements(state,
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/transforms/trigger.py", line 1308, in process_elements
    self.window_fn.merge(TriggerMergeContext(all_windows))
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_ULR/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py", line 423, in merge
    raise RuntimeError(result.error)
RuntimeError: java.lang.UnsupportedOperationException
	at org.apache.beam.sdk.transforms.windowing.InvalidWindows.mergeWindows(InvalidWindows.java:55)
	at org.apache.beam.fn.harness.WindowMergingFnRunner$MergingViaWindowFnRunner.mergeWindows(WindowMergingFnRunner.java:153)
	at org.apache.beam.fn.harness.MapFnRunners$CompressedValueOnlyMapperFactory.lambda$create$0(MapFnRunners.java:187)
	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:222)
	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:185)
	at org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:220)
	at org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:43)
	at org.apache.beam.sdk.fn.data.DecodingFnDataReceiver.accept(DecodingFnDataReceiver.java:25)
	at org.apache.beam.fn.harness.data.QueueingBeamFnDataClient.drainAndBlock(QueueingBeamFnDataClient.java:111)
	at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:308)
	at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:173)
	at org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:157)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

Issue Links

• relates to: BEAM-11803 PostCommit_XVR_Direct Failing
• links to: GitHub Pull Request #13998