[FLINK-23633] HybridSource: Support dynamic stop position in FileSource

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Connectors / HybridSource
• Labels: pull-request-available stale-assigned
• Assignee: Xinbin Huang
• Reporter: Thomas Weise
• Created: 04/Aug/21 20:07
• Updated: 26/Dec/23 06:34

Description

As of FLINK-22670 FileSource can be used with HybridSource with fixed end position. To support the scenario where the switch position isn't known ahead of time, FileSource needs to have a hook to decide when it is time to stop with continuous polling and then expose the end position through the enumerator.

Issue Links

• links to: GitHub Pull Request #20289