[FLINK-29757] ContinuousFileSplitEnumerator skip unprocessed splits when the file is splittable

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Component/s: Connectors / FileSystem
• Labels: pull-request-available stale-assigned
• Assignee: Hanley Yang
• Reporter: Hanley Yang
• Created: 25/Oct/22 12:28
• Updated: 15/Aug/23 10:35

Description

ContinuousFileSplitEnumerator use a HashSet<Path> to store processed splits. This works fine when process a file as a single split, once the file is splittable it will make unprocessed splits skipped.

Issue Links

• links to: GitHub Pull Request #21155