Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10740 FLIP-27: Refactor Source Interface
  3. FLINK-18680

Improve RecordsWithSplitIds API

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.11.1
    • 1.11.3, 1.12.0
    • Connectors / Common
    • None

    Description

      The current API requires some improvements in a few aspects:

      1. The current API enforces the SplitReaders to expose the records via a java collection which is not performance friendly in some cases.
      2. Some information does not change across the records, but the current RecordsWithSplitIds data structure does not support per-batch information. 

      Attachments

        Activity

          People

            sewen Stephan Ewen
            becket_qin Jiangjie Qin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: