[NIFI-9362] ListFTP / ListSFTP may occasionally duplicate files when Primary Node changes

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.13.0, 1.14.0, 1.13.1, 1.13.2, 1.15.0
• Fix Version/s: 1.16.0, 1.15.1
• Component/s: Extensions
• Assignee: Mark Payne
• Reporter: Mark Payne
• Created: 03/Nov/21 19:01
• Updated: 13/Dec/21 18:43
• Resolved: 04/Nov/21 17:47

Description

Create a ListFTP or ListSFTP processor in a clustered environment.
Run the processor and let it perform the listing.
Then disconnect the primary node so that a new node is elected.
The files that have the latest seen timestamp may now get duplicated.

Issue Links

• is caused by: NIFI-8136 Allow State Management to be tied to Process Session
• links to: GitHub Pull Request #5507