[FLINK-14971] Make all the non-IO operations in CheckpointCoordinator single-threaded

• Type: Sub-task
• Status: Reopened
• Priority: Major
• Resolution: Unresolved
• Component/s: Runtime / Checkpointing
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Biao Liu
• Created: 27/Nov/19 09:25
• Updated: 29/Sep/21 07:49

Description

Currently the ACK and declined message handling are executed in IO thread. This is the only rest part that non-IO operations are executed in IO thread. It blocks introducing main thread executor for CheckpointCoordinator. It would be resolved in this task.

After resolving the ACK and declined message issue, the main thread executor would be introduced into CheckpointCoordinator to instead of timer thread. However the timer thread would be kept (maybe for a while temporarily) to schedule periodic triggering, since FLINK-13848 is not accepted yet.

Issue Links

• causes: FLINK-16770 Resuming Externalized Checkpoint (rocks, incremental, scale up) end-to-end test fails with no such file
• links to: GitHub Pull Request #11347