Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4523

Allow Kinesis Consumer to start from specific timestamp / Date

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0
    • Component/s: Kinesis Connector
    • Labels:
      None

      Description

      We had a Kinesis user requesting this feature on an offline chat.

      To be specific, we let all initial Kinesis shards be iterated starting from records at the given timestamp.
      The AWS Java SDK we're using already provides API for this, so we can add this functionality with fairly low overhead: http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/kinesis/model/GetShardIteratorRequest.html#setTimestamp-java.util.Date-

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tonywei Wei-Che Wei
                Reporter:
                tzulitai Tzu-Li (Gordon) Tai
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: