[KAFKA-16996] The leastLoadedNode() function in kafka-client may choose a faulty node during the consumer thread starting and meanwhile one of the KAFKA server node is dead.

• Type: Bug
• Status: Open
• Priority: Blocker
• Resolution: Unresolved
• Affects Version/s: 2.0.1, 2.3.0, 3.6.0
• Component/s: clients
• Assignee: Unassigned
• Reporter: Goufu
• Created: 19/Jun/24 01:54
• Updated: 04/Aug/24 13:07

Description

The leastLoadedNode() function has a bug during the consumer process starting period. The function sendMetadataRequest() called by getTopicMetadataRequest() uses a random node which maybe faulty since every node‘s state recorded in the client thread is not ready yet. It happened in my production environment during my consumer thread restarting and meanwhile one of the KAFKA server node is dead. Then the client startup failed. 

I'm using the kafka-client-2.0.1.jar. I have checked the source code of higher versions and the issue still exists.