[NIFI-7901] Support an 'initial offset' on stateful SQL fetch processors where a max-value column is set

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Assignee: Unassigned
• Reporter: Alasdair Brown
• Created: 08/Oct/20 12:58
• Updated: 09/Oct/20 15:53
• Resolved: 08/Oct/20 18:54

Description

Where a max-value column is set, it would be beneficial to be able to set an 'initial offset' value, such that when there is no state to begin from, it uses the value of the initial offset.

 

The use case I am seeing for this is the desire to re-ingest the past X days only, without building a new flow/adding additional temporary wheres. They could simply stop the processor, update the initial offset, clear the state, and resume as normal.

 

E.g. on GenerateTableFetch