[FLINK-32768] SpeculativeSchedulerITCase.testSpeculativeExecutionOfInputFormatSource times out

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.18.0
• Fix Version/s: 1.18.0
• Component/s: Runtime / Coordination, Tests
• Labels: pull-request-available test-stability
• Assignee: Junrui Li
• Reporter: Matthias Pohl
• Created: 07/Aug/23 09:45
• Updated: 10/Aug/23 02:55
• Resolved: 10/Aug/23 02:55

Description

SpeculativeSchedulerITCase.testSpeculativeExecutionOfInputFormatSource is timing out:
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=52009&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=0c010d0c-3dec-5bf1-d408-7b18988b1b2b&l=9022

2023-08-06T05:34:27.1867230Z Aug 06 05:34:27 "ForkJoinPool-1-worker-1" #14 daemon prio=5 os_prio=0 tid=0x00007fb7d4e82800 nid=0x6dde7 waiting on condition [0x00007fb7834a4000]
2023-08-06T05:34:27.1867541Z Aug 06 05:34:27    java.lang.Thread.State: WAITING (parking)
2023-08-06T05:34:27.1867777Z Aug 06 05:34:27 	at sun.misc.Unsafe.park(Native Method)
2023-08-06T05:34:27.1868191Z Aug 06 05:34:27 	- parking to wait for  <0x00000000a77360d8> (a java.util.concurrent.CompletableFuture$Signaller)
2023-08-06T05:34:27.1868571Z Aug 06 05:34:27 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
2023-08-06T05:34:27.1868896Z Aug 06 05:34:27 	at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
2023-08-06T05:34:27.1869240Z Aug 06 05:34:27 	at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3313)
2023-08-06T05:34:27.1869682Z Aug 06 05:34:27 	at java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
2023-08-06T05:34:27.1870022Z Aug 06 05:34:27 	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
2023-08-06T05:34:27.1870395Z Aug 06 05:34:27 	at org.apache.flink.test.scheduling.SpeculativeSchedulerITCase.executeJob(SpeculativeSchedulerITCase.java:229)
2023-08-06T05:34:27.1870858Z Aug 06 05:34:27 	at org.apache.flink.test.scheduling.SpeculativeSchedulerITCase.testSpeculativeExecutionOfInputFormatSource(SpeculativeSchedulerITCase.java:165)
2023-08-06T05:34:27.1871251Z Aug 06 05:34:27 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[...]

Issue Links

• is caused by: FLINK-31843 Select slots from SlotPool#freeSlots in bulk
• is related to: FLINK-30846 SpeculativeSchedulerITCase.testSpeculativeExecutionOfInputFormatSource fails
• relates to: FLINK-32788 SpeculativeScheduler do not handle allocate task errors when schedule speculative tasks may causes resource leakage.
• links to: GitHub Pull Request #23165
• mentioned in: Page Loading...