[NIFI-2892] Implement AWS Kinesis Stream Get Processor

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.14.0
• Assignee: Chris Sampson
• Reporter: Stephane Maarek
• Created: 12/Oct/16 22:38
• Updated: 14/Jun/22 05:46
• Resolved: 12/May/21 18:20

Description

As the Kinesis Put Processor was just implemented in #1540, it would be great to have a Kinesis Get Processor.

The main challenges are making sure the SDKs we use for this have a license that authorise NiFi to bundle them with the main binaries.

I also know there are two models to read from a Kinesis Stream (push vs pull), and we may want to implement either or both, as part of one or multiple processors, for performance purposes. Open for discussions

Issue Links

• fixes: NIFI-8431 Redundant validation of Dynamic Properties
• relates to: NIFI-9520 Upgrade Kinesis Client Library to 1.14.4+
• links to: GitHub Pull Request #239
• links to: GitHub Pull Request #3582
• links to: GitHub Pull Request #4822