Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
Unknown
Description
The kafka component currently takes the body of the message and sends that directly into the kafka producer then sets the callback for when that particular message is delivered to the kafka server. This works, but is slow, particularly for thousands of little messages. (cannot really take advantage of the batching that is done in the kafka producer)
It would be good to allow the camel-kafka producer to accept various collections (Iterable and Iterator) and have it iterator through those creating kafka messages that can be uploaded and processed in a batch. dataformats (and aggregator) that can produce those could benefit tremendously.