[KAFKA-7824] Require member.id for initial join group request

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Component/s: consumer
• Assignee: Boyang Chen
• Reporter: Boyang Chen
• Created: 15/Jan/19 17:43
• Updated: 24/Mar/19 05:34
• Resolved: 15/Jan/19 21:27

Description

For request with unknown member id, broker will blindly accept the new join group request, store the member metadata and return a UUID to consumer. The edge case is that if initial join group request keeps failing due to connection timeout, or the consumer keeps restarting, or the max.poll.interval.ms configured on client is set to infinite (no rebalance timeout kicking in to clean up the member metadata map), there will be accumulated MemberMetadata info within group metadata cache which will eventually burst broker memory. The detection and fencing of invalid join group request is crucial for broker stability.

 

The proposed solution is to require one more bounce for the consumer to use a valid member.id to join the group. Details in this KIP

Issue Links

• links to: GitHub Pull Request #6058
• mentioned in: Page Loading...