Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10886 Event time synchronization across sources
  3. FLINK-10921

Prioritize shard consumers in Kinesis Consumer by event time

    XMLWordPrintableJSON

    Details

      Description

      Shard consumer threads currently emit records directly. In order to align shards by event time, decouple shard consumer threads and emitter with a queue, as described in [1].

      [1] https://lists.apache.org/thread.html/ac41718246ad8f6098efaf7dbf5f7182d60abdc473e8bf3c96ef5968@%3Cdev.flink.apache.org%3E

        Attachments

          Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. FLINK-5697 Add per-shard watermarks for FlinkKinesisConsumer

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #8517

          Web Link GitHub Pull Request #8577

            Activity

              People

              • Assignee:
                thw Thomas Weise
                Reporter:
                thw Thomas Weise
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m