[CAMEL-16782] Getting FailedToCreateProducerException with reason java.util.ConcurrentModificationException randomly when using huge split

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.11.0
• Fix Version/s: 3.11.1, 3.12.0
• Component/s: camel-core, camel-ftp
• Estimated Complexity: Unknown
• Assignee: Claus Ibsen
• Reporter: Tapio Piironen
• Created: 02/Jul/21 05:45
• Updated: 05/Jul/21 07:22
• Resolved: 02/Jul/21 15:08

Description

When splitting and then sending a huge list of strings(38 000) that create xml-documents for each line. Getting randomly this exception (so not for each line, about 5 times failed):

org.apache.camel.FailedToCreateProducerException: Failed to create Producer for endpoint: sftp://serverHere?disconnect=true. Reason: java.util.ConcurrentModificationException
at org.apache.camel.support.cache.DefaultProducerCache.acquireProducer(DefaultProducerCache.java:155) ~[?:?]
at org.apache.camel.support.cache.DefaultProducerCache.doInAsyncProducer(DefaultProducerCache.java:283) ~[?:?]
at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:190) ~[?:?]
at org.apache.camel.processor.errorhandler.RedeliveryErrorHandler$SimpleTask.run(RedeliveryErrorHandler.java:463) ~[?:?]
at org.apache.camel.impl.engine.DefaultReactiveExecutor$Worker.schedule(DefaultReactiveExecutor.java:179) ~[?:?]
at org.apache.camel.impl.engine.DefaultReactiveExecutor.schedule(DefaultReactiveExecutor.java:59) ~[?:?]
at org.apache.camel.processor.MulticastProcessor.lambda$schedule$1(MulticastProcessor.java:348) ~[?:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.util.ConcurrentModificationException
at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:1043) ~[?:?]
at java.util.ArrayList$Itr.next(ArrayList.java:997) ~[?:?]
at org.apache.camel.support.cache.ServicePool$MultiplePool.cleanupEvicts(ServicePool.java:318) ~[?:?]
at org.apache.camel.support.cache.ServicePool$MultiplePool.acquire(ServicePool.java:333) ~[?:?]
at org.apache.camel.support.cache.ServicePool$MultiplePool.acquire(ServicePool.java:296) ~[?:?]
at org.apache.camel.support.cache.ServicePool.acquire(ServicePool.java:109) ~[?:?]
at org.apache.camel.support.cache.DefaultProducerCache.acquireProducer(DefaultProducerCache.java:126) ~[?:?]
... 11 more

 

two routes:

<from uri="sftp: ..."/>

<split parallelProcessing="true">
 <tokenize token="\r\n|\n" xml="false" trim="true"/>
 <convertBodyTo type="java.lang.String" charset="UTF-8"/>
 <to uri="bean:createXML?method=collect"/>
 <to uri="direct:sendToSftpRoute"/>
</split>

 

<from uri="direct:sendToSftpRoute"/>

<to uri="sftp: ...?disconnect=true"/>

 

This issue came after upgrading from 3.4.2 -> 3.11.0