[FLINK-4020] Remove shard list querying from Kinesis consumer constructor

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Connectors / Common, Connectors / Kinesis
• Assignee: Tzu-Li (Gordon) Tai
• Reporter: Tzu-Li (Gordon) Tai
• Created: 04/Jun/16 09:40
• Updated: 05/Jul/16 18:40
• Resolved: 05/Jul/16 18:40

Description

Currently FlinkKinesisConsumer is querying for the whole list of shards in the constructor, forcing the client to be able to access Kinesis as well. This is also a drawback for handling Kinesis-side resharding, since we'd want all shard listing / shard-to-task assigning / shard end (result of resharding) handling logic to be capable of being independently done within task life cycle methods, with defined and definite results.

Issue Links

• Blocked: FLINK-3231 Handle Kinesis-side resharding in Kinesis streaming consumer
• links to: GitHub Pull Request #2081