[CAMEL-14076] camel-hdfs - Make the HdfsProducer compatible with RemoteFileConsumer (from(hdfs) -> to(sftp))

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: camel-hdfs
• Estimated Complexity: Advanced
• Assignee: Unassigned
• Reporter: Marius Cornescu
• Created: 17/Oct/19 07:13
• Updated: 30/Oct/19 04:37
• Resolved: 30/Oct/19 04:37

Description

  Users should be able to consume files from hadoop, and publish them to other destinations like sftp/ftp/...

  The *RemoteFileComponent*s look to me like the golden standard, so it would be nice to be able to make this component compatible with them.

  Currently, we have to set the chunkSize to a large enough number, so that only one message is produced, or do some aggregation after the consumer.

 

  This work should lay the ground for adding a streamDownload parameter for the consumer.

Issue Links

• links to: GitHub Pull Request #3285