[FLINK-18661] [Kinesis][EFO] Stream consumer Registration/Deregistration

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.12.0
• Component/s: Connectors / Kinesis
• Labels: pull-request-available
• Assignee: Danny Cranmer
• Reporter: Danny Cranmer
• Created: 21/Jul/20 09:28
• Updated: 19/Feb/21 07:21
• Resolved: 21/Sep/20 08:34

Description

Background
In order to utilise an EFO subscription a consumer must register and acquire a ConsumerARN. Subsequently the ConsumerARN can be used to request a subscription and start receiving data.

Scope

• Implement stream registration and deregistration in the KinesisV2Proxy/KinesisV2ProxyInterface
• Invoke registration based on the specified strategy:
  • LAZY: At start-up within KinesisDataFetcher
  • EAGER: Within FlinkKinesisConsumer constructor (add the consumer ARN to config)
  • NONE: Disabled
• Invoke deregistration based on the specified strategy:
  • LAZY|EAGER: During tear-down within KinesisDataFetcher
  • NONE: Disabled

Issue Links

• links to: GitHub Pull Request #13189