[NIFI-3068] NiFi can not reliably support multiple HDFS clusters in the same flow

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.1.0
• Component/s: Core Framework
• Labels: HDFS
• Assignee: Bryan Bende
• Reporter: Sam Hjelmfelt
• Created: 19/Nov/16 00:39
• Updated: 22/Feb/17 21:24
• Resolved: 22/Nov/16 21:42

Description

The HDFS configurations in PutHDFS are not respected when two (or more) PutHDFS processors exist with different configurations. The second processor to run will use the configurations from the first processor. This can cause data to be written to the wrong cluster.

This appears to be caused by configuration caching in AbstractHadoopProcessor, which would affect all HDFS processors.
https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-hadoop-bundle/nifi-hdfs-processors/src/main/java/org/apache/nifi/processors/hadoop/AbstractHadoopProcessor.java#L144

Issue Links

• is related to: NIFI-3520 HDFS processors experiencing Kerberos "impersonate" errors