[CAMEL-17590] Camel sftp kafka source connector

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 3.14.0
• Fix Version/s: 3.14.0
• Component/s: camel-sftp
• Estimated Complexity: Advanced
• Assignee: Unassigned
• Reporter: Sergio Gonzalez Meana
• Created: 02/Feb/22 23:02
• Updated: 05/Feb/22 18:22
• Resolved: 03/Feb/22 05:45

Description

Hello 
 
We are trying to read files using the following connector 
https://github.com/apache/camel-kafka-connector-examples/tree/main/sftp/sftp-source
The connector sends the whole file in one record to kafka (useless on large files).
we have files of 500MB
 
Is it possible to convert the whole record into small batches?

We unsuccessfully tried a couple of approaches with not luck.

The transform does not allow to return a list of newrecord -> public R apply(R r) {

 
Thanks in advance