[NIFI-3257] Cluster stability issues during high throughput

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.0.0, 1.1.0, 1.1.1, 1.0.1
• Component/s: Core Framework
• Assignee: Unassigned
• Reporter: Jeff Storck
• Created: 27/Dec/16 17:01
• Updated: 30/Mar/17 14:35

Description

During high throughput of data in a cluster (135MB/s), nodes experience frequent disconnects (every few minutes) and role switching (Primary and Cluster Coordinator). This makes API requests difficult since the requests can not be replicated to all nodes while reconnecting. The cluster can recover for a time (as mentioned above, for a few minutes) before going through another round of disconnects and role switching.

The cluster is able to continue to process data during these connection and role-switching issues.

Issue Links

• is related to: NIFI-3636 Session should not copy FlowFile Attribute Map when creating new FlowFile object unless attributes are changing
• is related to: NIFI-3648 Address Excessive Garbage Collection
• is related to: NIFI-3649 Parallelize Consumption of Cluster Replication Responses