[KAFKA-36] New producer API

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6
• Assignee: Unassigned
• Reporter: Anonymous
• Created: 19/Jul/11 21:32
• Updated: 19/Jul/11 21:32
• Resolved: 19/Jul/11 21:32

Description

We need to introduce a new Producer API that wraps the 2 low-level producer APIs - kafka.producer.SyncProducer and kafka.producer.async.AsyncProducer. The goal is to expose all the producer functionalities through a single API to the client. The new producer should be able to -

1. handle queueing/buffering of multiple producer requests and asynchronous dispatch of the batched data
2. handle the serialization of data through a user-specified Encoder
3. provide zookeeper based automatic broker discovery
4. provide software load balancing through an optionally user-specified Partitioner