[KAFKA-168] Support locality in consumer partition assignment algorithm

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Component/s: core
• Assignee: Unassigned
• Reporter: Jay Kreps
• Created: 24/Oct/11 17:30
• Updated: 08/Jun/16 22:15
• Resolved: 07/Feb/15 23:48

Description

There are some use-cases where it makes sense to co-locate brokers and consumer processes. In this case it would be nice to optimize the assignment of partitions to consumers so that the consumer preferentially consumes from the broker with which it is co-located.

If we are going to do KAFKA-167, moving the assignment to the broker, it would make sense to do that first so we only have to change the logic in one place.