Minor Description
The ```KinesisUtils.createStream()``` interface for creating Kinesis-based DStreams is quite brittle and requires adding a combinatorial number of overrides whenever another optional configuration parameter is added. This makes incorporating a lot of additional features supported by the Kinesis Client Library such as per-service authorization unfeasible. This interface should be replaced by a builder pattern class (https://en.wikipedia.org/wiki/Builder_pattern) to allow for greater extensibility.
Attachments
Issue Links
- is duplicated by
-
SPARK-10969 Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB
-
- Resolved
-
- links to
