[FLINK-9266] Upgrade AWS Kinesis Client version to 1.9.0 to reduce Kinesis describe streams calls

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.4.2
• Fix Version/s: 1.5.0
• Component/s: Connectors / Kinesis
• Labels: pull-request-available usability

Release Note

The default versions for AWS SDKs used in the Flink Kinesis connector has been upgraded. {{aws-java-sdk-kinesis}} has been upgraded to version '1.11.139', {{amazon-kinesis-client}} has been upgraded to version '1.9.0', and {{amazon-kinesis-producer}} to version '0.12.9'.

• Assignee: Thomas Moser
• Reporter: Thomas Moser
• Created: 27/Apr/18 18:41
• Updated: 02/May/18 12:19
• Resolved: 02/May/18 12:15

Description

Versions of the AWS Kinesis Client before 1.9.0 can cause a large number of Kinesis Describe Stream events which can result in other AWS services such as AWS CloudFormation failing to deploy any stacks with Kinesis streams in them. For accounts that use a large number of Kinesis streams and Flink clusters this can cripple the ability to deploy anything in the account. Bumping the version of the KCL to 1.9.0 changes to a different underlying call that has a much larger AWS account limit.

Issue Links

• links to: GitHub Pull Request #5932