[FLINK-18680] Improve RecordsWithSplitIds API

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.1
• Fix Version/s: 1.11.3, 1.12.0
• Component/s: Connectors / Common
• Assignee: Stephan Ewen
• Reporter: Jiangjie Qin
• Created: 23/Jul/20 07:31
• Updated: 15/Nov/20 22:06
• Resolved: 11/Sep/20 16:36

Description

The current API requires some improvements in a few aspects:

1. The current API enforces the SplitReaders to expose the records via a java collection which is not performance friendly in some cases.
2. Some information does not change across the records, but the current RecordsWithSplitIds data structure does not support per-batch information.