Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-293

Add a JDBC Processor for executing arbitrary SQL queries

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      This could be very useful for a variety of tasks, such as updating a value in a PostgreSQL table, or adding a new partition to Hive.

      Ideally, SQL commands could be generated using the NiFi expression language using FlowFile attributes.

      The processor should as generic as possible so that any of the popular JDBC drivers can be used (e.g. PostgreSQL, Hive, Impala).

      I'm still new to how processors are architected, but it seems that using a pre-defined service in the services.xml file (like the distributed map cache) would be the most efficient way to share a connection pool across multiple JDBC processors.

        Attachments

        1. AvroWriter.java
          3 kB
          Toivo Adams

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                rickysaltzer Ricky Saltzer
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: