Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-3335

GenerateTableFetch should allow you to specify an initial Max Value

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Extensions
    • Labels:
      None

      Description

      NIFI-2583 added the ability (via dynamic properties) to specify initial Max Values for columns, to enable the user to "pick up where they left off" if something happened with a flow, a NiFi instance, etc. where the state was stored but the processing did not complete successfully.

      This feature would also be helpful in GenerateTableFetch, which also supports max-value columns.

      Since NIFI-2881 adds incoming flow file support, it's more useful if Initial max values can be specified via flow file attributes. Because if a table name is dynamically passed via flow file attribute and Expression Language, user won't be able to configure dynamic processor attribute in advance for each possible table.

      Add dynamic properties ('initial.maxvalue.<max_value_column>' same as QueryDatabaseTable) to specify initial max values statically, and also use incoming flow file attributes named 'initial.maxvalue.<max_value_column>' if any.

        Activity

        Hide
        mattyb149 Matt Burgess added a comment -

        Peter Wicks Are you still working on this? If not, do you mind if I unassign it? Thanks!

        Show
        mattyb149 Matt Burgess added a comment - Peter Wicks Are you still working on this? If not, do you mind if I unassign it? Thanks!
        Hide
        patricker Peter Wicks added a comment -

        Matt Burgess I'm not working on this. I've unassigned myself.

        Show
        patricker Peter Wicks added a comment - Matt Burgess I'm not working on this. I've unassigned myself.

          People

          • Assignee:
            Unassigned
            Reporter:
            mattyb149 Matt Burgess
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:

              Development