[NIFI-6992] Add "Batch Size" property to GetHDFSFileInfo processor

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: Extensions
• Assignee: Tamas Palfy
• Reporter: Tamas Palfy
• Created: 08/Jan/20 15:03
• Updated: 13/Jan/20 17:04
• Resolved: 13/Jan/20 17:04

Description

GetHDFSFileInfo creates 1 output flowfile for every HDFS file when Grouping is set to None.
Other grouping strategies are adding a tree structure to the result instead of a flat structure.

I solution is required to be able to stream HDFS file info results into output but batched, so that huge amount of flowfiles residing in a single session can be prevented.

Issue Links

• links to: GitHub Pull Request #3966