[FLINK-34718] KeyedPartitionWindowedStream and NonPartitionWindowedStream IllegalStateException in AZP

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.20.0
• Fix Version/s: 1.20.0
• Component/s: API / DataStream
• Labels: pull-request-available test-stability
• Assignee: Ryan Skraba
• Reporter: Ryan Skraba
• Created: 18/Mar/24 12:51
• Updated: 21/Mar/24 11:08
• Resolved: 20/Mar/24 08:13

Description

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=58320&view=logs&j=8fd9202e-fd17-5b26-353c-ac1ff76c8f28&t=ea7cf968-e585-52cb-e0fc-f48de023a7ca&l=9646

18 of the KeyedPartitionWindowedStreamITCase and NonKeyedPartitionWindowedStreamITCase unit tests introduced in FLINK-34543 are failing in the adaptive scheduler profile, with errors similar to:

Mar 15 01:54:12 Caused by: java.lang.IllegalStateException: The adaptive scheduler supports pipelined data exchanges (violated by MapPartition (org.apache.flink.streaming.runtime.tasks.OneInputStreamTask) -> ddb598ad156ed281023ba4eebbe487e3).
Mar 15 01:54:12 	at org.apache.flink.util.Preconditions.checkState(Preconditions.java:215)
Mar 15 01:54:12 	at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.assertPreconditions(AdaptiveScheduler.java:438)
Mar 15 01:54:12 	at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.<init>(AdaptiveScheduler.java:356)
Mar 15 01:54:12 	at org.apache.flink.runtime.scheduler.adaptive.AdaptiveSchedulerFactory.createInstance(AdaptiveSchedulerFactory.java:124)
Mar 15 01:54:12 	at org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:121)
Mar 15 01:54:12 	at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:384)
Mar 15 01:54:12 	at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:361)
Mar 15 01:54:12 	at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:128)
Mar 15 01:54:12 	at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:100)
Mar 15 01:54:12 	at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112)
Mar 15 01:54:12 	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
Mar 15 01:54:12 	... 4 more
 

Issue Links

• links to: GitHub Pull Request #24533