[NIFI-4906] Add GetHdfsFileInfo Processor

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.7.0
• Component/s: Extensions
• Labels: patch pull-request-available
• Assignee: Ed Berezitsky
• Reporter: Ed Berezitsky
• Created: 23/Feb/18 15:35
• Updated: 18/Jun/18 13:34
• Resolved: 18/Jun/18 13:34

Description

Add GetHdfsFileInfo Processor to be able to get stats from a file system.

This processor should support recursive scan, getting information of directories and files.

File-level info required: name, path, length, modified timestamp, last access timestamp, owner, group, permissions.

Directory-level info required: name, path, sum of lengths of files under a dir, count of files under a dir, modified timestamp, last access timestamp, owner, group, permissions.

 

The result returned:

• in single flow file (in content - a json line per file/dir info);
• flow file per each file/dir info (in content as json obj or in set of attributes by the choice).

Issue Links

• links to: GitHub Pull Request #2639