[KAFKA-564] Wildcard-based topic consumption should assign partitions to threads uniformly

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.8.1
• Assignee: Unassigned
• Reporter: Joel Jacob Koshy
• Created: 10/Oct/12 16:39
• Updated: 07/Oct/16 16:51
• Resolved: 19/Jun/14 18:11

Description

Right now, if when a client uses createMessageStreamsByFilter and specifies 'n' streams (threads), 'n' should be <= the max partition count of any topic. If it is greater than that, the excess threads will be idle. However, it would be better to allow a greater number of threads and spread all the available partitions across the threads.
This should not be too difficult, but may require significant refactoring.

Although it is relevant to current trunk/0.7, we will target this for post-0.8.

Issue Links

• duplicates: KAFKA-687 Rebalance algorithm should consider partitions from all topics