[NIFI-6266] FTP processors do not honor Proxy settings

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.2, 1.11.4, 1.15.2
• Fix Version/s: 1.16.0
• Assignee: David Handermann
• Reporter: Steven Arnott
• Created: 06/May/19 14:40
• Updated: 28/Jun/22 13:09
• Resolved: 27/Jan/22 23:07

Description

Trying to use GetFTP to download a file via our company proxy.  But the processor does not seem to honor the proxy settings in any way.

The GetFTP issues a connection timeout error:

2019-05-06 10:32:17,065 ERROR [Timer-Driven Process Thread-10] o.apache.nifi.processors.standard.GetFTP GetFTP[id=7f520fd2-016a-1000-5012-ae01d3493bfa] Unable to fetch listing from remote server due to java.net.ConnectException: Connection timed out (Connection timed out): java.net.ConnectException: Connection timed out (Connection timed out)
java.net.ConnectException: Connection timed out (Connection timed out)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.apache.commons.net.SocketClient._connect(SocketClient.java:243)
at org.apache.commons.net.SocketClient.connect(SocketClient.java:181)
at org.apache.nifi.processors.standard.util.FTPTransfer.getClient(FTPTransfer.java:585)
at org.apache.nifi.processors.standard.util.FTPTransfer.getListing(FTPTransfer.java:228)
at org.apache.nifi.processors.standard.util.FTPTransfer.getListing(FTPTransfer.java:191)
at org.apache.nifi.processors.standard.GetFileTransfer.fetchListing(GetFileTransfer.java:284)
at org.apache.nifi.processors.standard.GetFileTransfer.onTrigger(GetFileTransfer.java:127)
at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1162)
at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:209)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

The process is configured thus to hit a netcat process to see if any connection is made

When I change the target of the FTP to this debug endpoint it does shows it connecting to my listener for the FTP server but not to the proxy.

Running 1.9.2 in a Docker container.

 

Issue Links

• causes: NIFI-10158 ListFTP required field can not use Variable Registry.
• is duplicated by: NIFI-7997 ListFTP does not use HTTP proxy
• is duplicated by: NIFI-8065 ListFTP processor tries to resolve the hostname even if proxy is configured
• links to: GitHub Pull Request #5655