[NIFI-7320] HDFS Content Repository

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Abandoned
• Affects Version/s: 1.12.0
• Component/s: Extensions
• Labels: ready-to-commit
• Assignee: Unassigned
• Reporter: Andrew Glowacki
• Created: 05/Apr/20 16:18
• Updated: 06/Apr/20 17:36
• Resolved: 06/Apr/20 17:36

Description

This issue is for a new content repository that stores FlowFile content in HDFS instead of the local disk. While storage capacity for a NiFi cluster can be expanded by adding more nodes, this doesn't make sense if the only reason is to increase content repository storage or I/O capacity.

In addition to just storing all content in HDFS, the repository can also:

• Store content in the local disk as normal, and fallback to HDFS when the local disk is full
• Store content in HDFS but fallback to a local disk if a failure occurs.
• Store content in the local disk as normal, and only store archived content in HDFS for longer retention.

Issue Links

• links to: GitHub Pull Request #4184