[FLINK-14175] Upgrade KPL version in flink-connector-kinesis to fix application OOM

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.3, 1.6.4, 1.6.5, 1.7.2, 1.7.3, 1.8.0, 1.8.1, 1.8.2, 1.9.0
• Fix Version/s: 1.8.3, 1.9.2
• Component/s: Connectors / Kinesis
• Labels: pull-request-available
• Assignee: Abhilasha Seth
• Reporter: Abhilasha Seth
• Created: 23/Sep/19 22:01
• Updated: 29/Nov/19 15:45
• Resolved: 24/Oct/19 18:16

Description

The KPL version (0.12.9) used by flink-connector-kinesis in the affected Flink versions has a thread leak bug that causes applications to run out of memory after frequent restarts:

KPL Issue - https://github.com/awslabs/amazon-kinesis-producer/issues/224

Fix - https://github.com/awslabs/amazon-kinesis-producer/pull/225/files

Upgrading KPL to 0.12.10 or higher is necessary to avoid this issue. The recommended version to upgrade would be the latest (0.13.1)

Note that KPL version in Flink 1.10.0 has been updated to the latest version (0.13.1): https://issues.apache.org/jira/browse/FLINK-12847

 

Issue Links

• causes: FLINK-14995 Kinesis NOTICE is incorrect
• links to: GitHub Pull Request #9938
• links to: GitHub Pull Request #9939