[FLINK-19666] CLONE - [Kinesis][EFO] Add AWS SDK v2.x dependency and KinesisProxyV2

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: 1.12.0
• Component/s: Connectors / Kinesis
• Labels: pull-request-available
• Assignee: Danny Cranmer
• Reporter: Mohit Paliwal
• Created: 15/Oct/20 20:02
• Updated: 15/Oct/20 20:05
• Resolved: 15/Oct/20 20:05

Description

Background

EFO requires the AWS SDK v2.x dependency. Version 1.x cannot be removed from the project as other modules require it (DynamoDB streams and KPL), therefore we will use AWS SDK 1.x and 2.x side by side.

Scope

This change will introduce the new dependency and Kinesis V2 proxy:

• Update pom file to include the new dependency
  • This should be shaded and relocated into the connector jar (similar to V1)
• Add a KinesisProxyV2 skeleton interface (methods and implementation will come in follow up tasks)
• Add utility methods to create an AWS SDK v2.x Kinesis Client from connector properties, including:
  • Region
  • Credential Provider 
  • HTTP Client config
  • Other properties

Issue Links

• is a clone of: FLINK-18513 [Kinesis][EFO] Add AWS SDK v2.x dependency and KinesisProxyV2