[NIFI-1588] ListHDFS to retaining wrong state in zookeeper

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.1
• Fix Version/s: 0.6.0
• Component/s: Core Framework
• Environment: latest 0.5.1
• Assignee: Mark Payne
• Reporter: Matthew Clarke
• Created: 03/Mar/16 21:37
• Updated: 14/Mar/16 20:07
• Resolved: 14/Mar/16 20:07

Description

The expected state that should be retained by listHDFS processor is the last modified timestamp. The processor instead is retaining the filename and path of every file it lists. This results in excessive disk usage by zookeeper to retain this filename based state.