Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-9691

Modify run loop in Kinesis ShardConsumer to not sleep for a fixed fetchIntervalMillis

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.2, 1.5.0
    • Fix Version/s: 1.5.2, 1.6.0
    • Component/s: Connectors / Kinesis
    • Labels:
      None

      Description

      Currently the ShardConsumer in the Kinesis connector sleeps for a fixed fetchIntervalMillis resulting in the shard consumer sleeping for more time than necessary and not optimally reading from Kinesis. It should only be sleeping for (fetchIntervalMillis - time taken to process records) before making the subsequent getRecords call. 

        Attachments

          Activity

            People

            • Assignee:
              jgrier Jamie Grier
              Reporter:
              glaksh100 Lakshmi Rao
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: