Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-5697

Add per-shard watermarks for FlinkKinesisConsumer

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      It would be nice to let the Kinesis consumer be on-par in functionality with the Kafka consumer, since they share very similar abstractions. Per-partition / shard watermarks is something we can add also to the Kinesis consumer.

      Attachments

        Issue Links

        blocks

        Sub-task - The sub-task of the issue FLINK-10921 Prioritize shard consumers in Kinesis Consumer by event time

        • Major - Major loss of function.
        • Resolved
        is blocked by

        Improvement - An improvement or enhancement to an existing feature or task. FLINK-6349 Enforce per-subtask record ordering on resharding for FlinkKinesisConsumer

        • Major - Major loss of function.
        • Open
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. FLINK-8648 Allow for customization of emitRecordAndUpdateState in Kinesis connector

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
        links to

        Web Link GitHub Pull Request #6980

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            thw Thomas Weise
            tzulitai Tzu-Li (Gordon) Tai
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment