[KAFKA-7206] Enable batching in FindCoordinator

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Fix Version/s: 3.0.0
• Component/s: admin
• Labels: needs-discussion needs-kip newbie++
• Assignee: Yishun Guan
• Reporter: Yishun Guan
• Created: 25/Jul/18 23:14
• Updated: 15/Nov/22 16:16
• Resolved: 15/Nov/22 16:16

Description

To quote guozhang :

"The proposal is that, we extend FindCoordinatorRequest to have multiple consumer ids: today each FindCoordinatorRequest only contains a single consumer id, so in our scenario we need to send N request for N consumer groups still. If we can request for coordinators in a single request, then the workflow could be simplified to:

1. send a single FindCoordinatorRequest to a broker asking for coordinators of all consumer groups.
   1.a) note that the response may still succeed in finding some coordinators while error on others, and we need to handle them on that granularity (see below).
2. and then for the collected coordinator, group them by coordinator id and send one request per coordinator destination.

Note that this change would require the version to be bumped up, to FIND_COORDINATOR_REQUEST_V3 for such protocol changes, also the RESPONSE version should be bumped up in order to include multiple coordinators."

A KIP is needed.