Details
-
Sub-task
-
Status: Closed
-
Critical
-
Resolution: Fixed
-
1.13.0
Description
Currently, the AdaptiveScheduler creates the ExecutionGraph in the main thread. This also means that we are recovering state in the JobMasters's main thread. This can lead to instabilities because we are blocking the main thread for too long. I think the creation of the ExecutionGraph should happen in an ioExecutor.
Attachments
Issue Links
- links to