[CAMEL-16916] camel split with parallel processing true consumes lots of heap space when using camel-ftp

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.11.1
• Fix Version/s: 3.7.6, 3.11.3, 3.13.0
• Component/s: camel-core

Environment

RHEL Linux 7

Karaf 3.2.1

OpenJDK 11

• Estimated Complexity: Unknown
• Assignee: Claus Ibsen
• Reporter: Tapio Piironen
• Created: 02/Sep/21 12:01
• Updated: 28/Sep/21 10:20
• Resolved: 28/Sep/21 10:20

Description

Camel split with parallel processing true consumes lots of heap space and eventually (after several huge runs) makes java run out of heap space. Reading 50 000 lines from source and creating 50 000 responses as xml files. Out of heap space happends after 3-4 runs (once a day). Workaround is to make parallelProcessing to false .

My route:

<from uri="sftp://server?fileName=list.txt"/>

<split parallelProcessing="true">
 <tokenize token="\r\n|\n" xml="false" trim="true"/>
 <convertBodyTo type="java.lang.String" charset="UTF-8"/>
 <to uri="bean:collectDataByBody?method=collect"/>
 <to uri="direct:sendToSftp"/>
</split>

<from uri="direct:sendToSftp"/>
<choice>
<when>
<simple>${body} != null</simple>
<marshal>
<jaxb contextPath="fi.package.entity"/>
</marshal>
<to uri="sftp://server/answers?disconnect=true"/>
</when>
<otherwise></otherwise>
</choice>