[FLINK-34792] [Bug] Incremental source never switches to streaming mode with disabled checkpointing and parallelism > 1

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Flink CDC
• Labels: github-import
• Assignee: Unassigned
• Reporter: Flink CDC Issue Import
• Created: 20/Mar/24 09:21
• Updated: 25/Oct/24 08:01

Description

1. 1. 1. Search before asking

• [X] I searched in the [issues|https://github.com/ververica/flink-cdc-connectors/issues) and found nothing similar.

1. 1. 1. Flink version

1.13.6, 1.14.4, 1.15.2, 1.16.0, 1.17.0

1. 1. 1. Flink CDC version

2.3.0, 2.4-SNAPSHOT

1. 1. 1. Database and its version

Any connector with incremental source implementation

1. 1. 1. Minimal reproduce step

For instance, remove
```sql
SET 'execution.checkpointing.interval' = '3s';
```
from `MySqlE2eITCase#testMySqlCDC(]`

1. 1. 1. What did you expect to see?

Failed job or at least error message describing that the user must enable checkpointing for the connector to work correctly

1. 1. 1. What did you see instead?

If parallelism of incremental source is greater than one, implementations of `SnapshotSplitAssigner` wait for completed checkpoint event to set flag field, that triggers `HybridSplitAssigner` to switch to streaming mode. If checkpointing is disabled, then flag field is never set to it's final state, which leads to the fact that the source is forever stuck in the snapshot mode. So, I think we need to forbid users to run jobs with incremental sources without enabled checkpointing.

1. 1. 1. Anything else?

No response

1. 1. 1. Are you willing to submit a PR?

• [ ] I'm willing to submit a PR!

---------------- Imported from GitHub ----------------
Url: https://github.com/apache/flink-cdc/issues/2165
Created by: tigrulya-exe
Labels: bug,
Created at: Tue May 30 15:39:27 CST 2023
State: open