[NIFI-853] Create Processors to put JSON data to a Relational Database

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.3.0
• Component/s: Extensions
• Assignee: Mark Payne
• Reporter: Mark Payne
• Created: 14/Aug/15 13:04
• Updated: 19/Aug/15 21:43
• Resolved: 19/Aug/15 21:43

Description

Most of the discussion/design for these processors happened in the comments of NIFI-293, which was the initial ticket for implementing JDBC functionality in NiFi, but was closed in a previous version, so this ticket was created to do the work.

The idea is to have a processor that will take in FlowFiles whose contents are arbitrary SQL INSERT/UPDATE commands. The commands can be parameterized with the parameters' values and types in FlowFile attributes.

We then should have a processor that converts a JSON document into a SQL command to either update or insert data into a database table. We will also want some other processors in the future probably to handle other data types, such as converting XML, CSV, Avro, etc. into SQL commands.

This breakout gives us a nice coherence to the "do only one thing and do it well" principle by separating the logic of handling all of the incoming formats from the logic of updating the database.

Issue Links

• is related to: NIFI-293 Add a JDBC Processor for executing arbitrary SQL queries