[NIFI-4241] ListSFTP node in Nifi cluster is sending warnings for unreachable peers

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.3.0
• Environment: Docker container within VM:; docker@myvm5:~$ uname -a; Linux myvm5 4.4.74-boot2docker #1 SMP Mon Jun 26 18:01:14 UTC 2017 x86_64 GNU/Linux
• Assignee: Unassigned
• Reporter: Frank Thiele
• Created: 31/Jul/17 06:29
• Updated: 01/Aug/17 07:29

Description

I have setup a small cluster with 3 nodes nifi1:8080, nifi2:8081 and nifi3:8082.
When I configure a ListSFTP processor and run it, the following warning comes up:

2017-07-31 06:25:05,763 INFO [Clustering Tasks Thread-2] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2017-07-31 06:25:05,754 and sent to nifi1:10600 at 2017-07-31 06:25:05,763; send took 9 millis
2017-07-31 06:25:07,947 WARN [Http Site-to-Site PeerSelector] o.apache.nifi.remote.client.PeerSelector Could not communicate with nifi1:8081 to determine which nodes exist in the remote NiFi cluster, due to org.apache.http.conn.HttpHostConnectException: Connect to nifi1:8081 [nifi1/10.0.0.32] failed: Connection refused (Connection refused)
2017-07-31 06:25:07,947 WARN [Http Site-to-Site PeerSelector] o.apache.nifi.remote.client.PeerSelector org.apache.nifi.remote.client.PeerSelector@4516d212 Unable to refresh Remote Group's peers due to Unable to communicate with remote NiFi cluster in order to determine which nodes exist in the remote cluster
2017-07-31 06:25:10,775 INFO [Clustering Tasks Thread-1] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2017-07-31 06:25:10,764 and sent to nifi1:10600 at 2017-07-31 06:25:10,775; send took 10 millis
2017-07-31 06:25:12,951 WARN [Http Site-to-Site PeerSelector] o.apache.nifi.remote.client.PeerSelector Could not communicate with nifi1:8081 to determine which nodes exist in the remote NiFi cluster, due to org.apache.http.conn.HttpHostConnectException: Connect to nifi1:8081 [nifi1/10.0.0.32] failed: Connection refused (Connection refused)
2017-07-31 06:25:12,951 WARN [Http Site-to-Site PeerSelector] o.apache.nifi.remote.client.PeerSelector org.apache.nifi.remote.client.PeerSelector@4516d212 Unable to refresh Remote Group's peers due to Unable to communicate with remote NiFi cluster in order to determine which nodes exist in the remote cluster
2017-07-31 06:25:15,781 INFO [Clustering Tasks Thread-3] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2017-07-31 06:25:15,775 and sent to nifi1:10600 at 2017-07-31 06:25:15,781; send took 5 millis
2017-07-31 06:25:17,954 WARN [Http Site-to-Site PeerSelector] o.apache.nifi.remote.client.PeerSelector Could not communicate with nifi1:8081 to determine which nodes exist in the remote NiFi cluster, due to org.apache.http.conn.HttpHostConnectException: Connect to nifi1:8081 [nifi1/10.0.0.32] failed: Connection refused (Connection refused)
2017-07-31 06:25:17,955 WARN [Http Site-to-Site PeerSelector] o.apache.nifi.remote.client.PeerSelector org.apache.nifi.remote.client.PeerSelector@4516d212 Unable to refresh Remote Group's peers due to Unable to communicate with remote NiFi cluster in order to determine which nodes exist in the remote cluster
2017-07-31 06:25:20,790 INFO [Clustering Tasks Thread-2] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2017-07-31 06:25:20,782 and sent to nifi1:10600 at 2017-07-31 06:25:20,790; send took 7 millis
2017-07-31 06:25:22,959 WARN [Http Site-to-Site PeerSelector] o.apache.nifi.remote.client.PeerSelector Could not communicate with nifi1:8081 to determine which nodes exist in the remote NiFi cluster, due to org.apache.http.conn.HttpHostConnectException: Connect to nifi1:8081 [nifi1/10.0.0.32] failed: Connection refused (Connection refused)
2017-07-31 06:25:22,959 WARN [Http Site-to-Site PeerSelector] o.apache.nifi.remote.client.PeerSelector org.apache.nifi.remote.client.PeerSelector@4516d212 Unable to refresh Remote Group's peers due to Unable to communicate with remote NiFi cluster in order to determine which nodes exist in the remote cluster
2017-07-31 06:25:25,798 INFO [Clustering Tasks Thread-1] o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2017-07-31 06:25:25,790 and sent to nifi1:10600 at 2017-07-31 06:25:25,798; send took 6 millis
2017-07-31 06:25:27,962 WARN [Http Site-to-Site PeerSelector] o.apache.nifi.remote.client.PeerSelector Could not communicate with nifi1:8081 to determine which nodes exist in the remote NiFi cluster, due to org.apache.http.conn.HttpHostConnectException: Connect to nifi1:8081 [nifi1/10.0.0.32] failed: Connection refused (Connection refused)
2017-07-31 06:25:27,962 WARN [Http Site-to-Site PeerSelector] o.apache.nifi.remote.client.PeerSelector org.apache.nifi.remote.client.PeerSelector@4516d212 Unable to refresh Remote Group's peers due to Unable to communicate with remote NiFi cluster in order to determine which nodes exist in the remote cluster

This is unexpected as the node address is wrong – it should be nifi1:8080 instead of nifi1:8082 (being the port of the local machine I have taken the warning from). The same error I can see in the logs of nifi2 (for peer "nifi1:8081").

Issue Links

• relates to: NIFI-2343 ListFile processor state can't be accessed due to Zk CONNECTIONLOSS