Details
Description
This involves adding basic fetch functionality (equivalent to SimpleConsumer) to the new consumer. Effectively:
1) Implement subscribe(TopicPartition...partitions) and unsubscribe(TopicPartition...partitions).
2) Implement pool(timeout).
3) Add memory management to the consumer.
Issue Links
- blocks
-
KAFKA-1331
Add ability to commit offsets to the new consumer
-
- Resolved
-
- duplicates
-
KAFKA-1760
Implement new consumer client
-
- Resolved
-
Activity
- All
- Comments
- Work Log
- History
- Activity
- Transitions
Created reviewboard https://reviews.apache.org/r/23442/
against branch trunk
Hey nicu marasoiu, sorry had actually been working on this for the last week...I should have assigned it to myself.
Guys, I posted a very rough draft that implements "simple consumer" functionality. I think implementing offset maintainence on top of this will be pretty easy and can be done once we have those new request defn's done. I'd like to start getting these changes in even though they aren't done to avoid keeping large patches against trunk. Specifically what I am hoping is that we can do a detailed review on the changes to common code, esp with respect to NetworkClient and be a bit lax on KafkaConsumer until we get something more complete.
Updated reviewboard https://reviews.apache.org/r/23442/
against branch trunk
Done as part of KAFKA-1760
Hi,
If I want to take this, how much time to get up to speed do I have?
Which are the documents to read?
I have kafka experience and scala courses, I will try to jump in