[CAMEL-11119] Performance issue in Camel SFTP component

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.15.2
• Component/s: camel-sftp
• Estimated Complexity: Unknown
• Assignee: Unassigned
• Reporter: Ayush Dixit
• Created: 06/Apr/17 13:27
• Updated: 06/Apr/17 13:37
• Resolved: 06/Apr/17 13:37

Description

Camel SFTP is taking long time to transfer the file to target sftp location.

The file took around 3 min when target directory contain 40,000 file. I had put around 22 files , So the total time it took to transfer 22 files is around 22 * 3 min = 66 min. The behaviour is exponential the number of files you increase on target directory. The camel route will take more time to transfer the file to target directory.

I have enabled camel logger in DEBUG . I try to debug , what I observed is it is reading that is taking time. PFB logger.

INFO 07:47:23 (Camel (cfgMgrCamelContext) thread #6 - file:///data/users/slvm02/smp53/domains/vmb/Icoms/iop_responses/1) com.sigma.samp.imp.virginmedia.bss.voice.camelroutes.iopRoute.IOPResponseFtpRouteBuilder> Sending IOP response file : SX30RPMAJAR1702483756.txt to ICOMS FTP directory

DEBUG 07:47:23 (Camel (cfgMgrCamelContext) thread #6 - file:///data/users/slvm02/smp53/domains/vmb/Icoms/iop_responses/1) org.apache.camel.processor.SendProcessor> >>>> Endpoint[sftp://10.100.150. 190/icoms/1?download=false&maxMessagesPerPoll=10&password=xxxxxx&
tempPrefix=Q&username=sigmauser] Exchange[SX30RPMAJAR1702483756.txt]

DEBUG 07:50:40 (Camel (cfgMgrCamelContext) thread #6 - file:///data/users/slvm02/smp53/domains/vmb/Icoms/iop_responses/1) org.apache.camel.component.file.GenericFileConverter> Read file /data/users/slvm02/smp53/domains/vmb/Icoms/iop_responses/1/SX30RPMAJA 1702483756.txt(no charset)

For more details , Refer below .
http://camel.465427.n5.nabble.com/Performance-issue-in-Camel-SFTP-component-td5796893.html