[FLINK-22828] Allow using a custom AWS credentials provider for AWS Connectors

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Done
• Affects Version/s: aws-connector-4.1.0
• Fix Version/s: aws-connector-4.2.0
• Component/s: Connectors / Kinesis
• Labels: auto-unassigned pull-request-available
• Assignee: Emre Kartoglu
• Reporter: Arvid Heise
• Created: 01/Jun/21 10:01
• Updated: 24/Apr/23 14:39
• Resolved: 24/Apr/23 14:38

Description

Users currently have to use the credential providers that are pre-configured in Kinesis connector.

For advanced users, it would be nice to be able to configure it similar to Presto: https://prestodb.io/docs/0.187/connector/hive.html#custom-s3-credentials-provider

Issue Links

• is related to: FLINK-13602 S3 Presto filesystem effectively does not support credential providers
• is related to: FLINK-17859 [flink-s3-fs-presto] Upgrade the dependent presto-hive jar to latest version
• links to: GitHub Pull Request #69