[FLINK-33416] FineGrainedSlotManagerTest failed with fatal error

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: Runtime / Coordination
• Labels: github-actions test-stability
• Assignee: Unassigned
• Reporter: Matthias Pohl
• Created: 31/Oct/23 11:29
• Updated: 02/Apr/24 10:11
• Resolved: 02/Apr/24 10:11

Description

In FLINK-33245, we reported an error of the ZooKeeperLeaderElectionConnectionHandlingTest failure due to a fatal error. The corresponding build is this one.

But the stacktrace indicates that it's actually FineGrainedSlotManagerTest which ran before the ZK-related test:

Test org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManagerTest.testSlotAllocationAccordingToStrategyResult[testSlotAllocationAccordingToStrategyResult()] successfully run.
================================================================================
19:30:11,463 [   pool-752-thread-1] ERROR org.apache.flink.util.FatalExitExceptionHandler              [] - FATAL: Thread 'pool-752-thread-1' produced an uncaught exception. Stopping the process...
java.util.concurrent.CompletionException: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@1201ef67[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@1ea6ccfa[Wrapped task = java.util.concurrent.CompletableFuture$UniHandle@36f84d94]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@4642c78d[Shutting down, pool size = 1, active threads = 1, queued tasks = 1, completed tasks = 194]
        at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:314) ~[?:?]
        at java.util.concurrent.CompletableFuture.uniHandleStage(CompletableFuture.java:951) ~[?:?]
        at java.util.concurrent.CompletableFuture.handleAsync(CompletableFuture.java:2276) ~[?:?]
        at org.apache.flink.runtime.resourcemanager.slotmanager.DefaultSlotStatusSyncer.allocateSlot(DefaultSlotStatusSyncer.java:138) ~[classes/:?]
        at org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager.allocateSlotsAccordingTo(FineGrainedSlotManager.java:722) ~[classes/:?]
        at org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager.checkResourceRequirements(FineGrainedSlotManager.java:645) ~[classes/:?]
        at org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager.lambda$checkResourceRequirementsWithDelay$12(FineGrainedSlotManager.java:603) ~[classes/:?]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
        at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
        at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@1201ef67[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@1ea6ccfa[Wrapped task = java.util.concurrent.CompletableFuture$UniHandle@36f84d94]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@4642c78d[Shutting down, pool size = 1, active threads = 1, queued tasks = 1, completed tasks = 194]
        at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
        at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
        at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
        at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
        at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
        at java.util.concurrent.CompletableFuture.uniHandleStage(CompletableFuture.java:949) ~[?:?]
        ... 11 more
[...]

I leave this issue open for documentation purposes for now. ...in case the issue pops up again.

Issue Links

• duplicates: FLINK-34427 FineGrainedSlotManagerTest fails fatally (exit code 239)