Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-9266

Upgrade AWS Kinesis Client version to 1.9.0 to reduce Kinesis describe streams calls

    XMLWordPrintableJSON

    Details

    • Release Note:
      Hide
      The default versions for AWS SDKs used in the Flink Kinesis connector has been upgraded. {{aws-java-sdk-kinesis}} has been upgraded to version '1.11.139', {{amazon-kinesis-client}} has been upgraded to version '1.9.0', and {{amazon-kinesis-producer}} to version '0.12.9'.
      Show
      The default versions for AWS SDKs used in the Flink Kinesis connector has been upgraded. {{aws-java-sdk-kinesis}} has been upgraded to version '1.11.139', {{amazon-kinesis-client}} has been upgraded to version '1.9.0', and {{amazon-kinesis-producer}} to version '0.12.9'.

      Description

      Versions of the AWS Kinesis Client before 1.9.0 can cause a large number of Kinesis Describe Stream events which can result in other AWS services such as AWS CloudFormation failing to deploy any stacks with Kinesis streams in them. For accounts that use a large number of Kinesis streams and Flink clusters this can cripple the ability to deploy anything in the account. Bumping the version of the KCL to 1.9.0 changes to a different underlying call that has a much larger AWS account limit.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tmoser2525 Thomas Moser
                Reporter:
                tmoser2525 Thomas Moser
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: