[SPARK-28631] Update Kinesis dependencies to the Apache version licensed versions

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: DStreams
• Assignee: Unassigned
• Reporter: Ismaël Mejía
• Created: 05/Aug/19 20:38
• Updated: 16/Mar/20 22:54

Description

Amazon has released new versions of its Kinesis libraries (KCL and KPL) with the Apache license. It is probably a good idea to update the kinesis modules to use it. This may also allow Spark to distribute the spark kinesis jars as part of the normal distribution without any legal issue with the ASF.