Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-293

Add a JDBC Processor for executing arbitrary SQL queries

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      This could be very useful for a variety of tasks, such as updating a value in a PostgreSQL table, or adding a new partition to Hive.

      Ideally, SQL commands could be generated using the NiFi expression language using FlowFile attributes.

      The processor should as generic as possible so that any of the popular JDBC drivers can be used (e.g. PostgreSQL, Hive, Impala).

      I'm still new to how processors are architected, but it seems that using a pre-defined service in the services.xml file (like the distributed map cache) would be the most efficient way to share a connection pool across multiple JDBC processors.

      Attachments

        1. AvroWriter.java
          3 kB
          Toivo Adams

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rickysaltzer Ricky Saltzer
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: