[KAFKA-6863] Kafka clients should try to use multiple DNS resolved IP addresses if the first one fails

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0, 1.1.0
• Fix Version/s: 2.1.0
• Component/s: clients
• Assignee: Edoardo Comar
• Reporter: Edoardo Comar
• Reviewer: Rajini Sivaram
• Created: 04/May/18 13:13
• Updated: 29/Dec/18 09:05
• Resolved: 11/Oct/18 17:47

Description

Currently Kafka clients resolve a symbolic hostname using
 new InetSocketAddress(String hostname, int port)

which only picks one IP address even if the DNS has multiple records for the hostname, as it calls
InetAddress.getAllByName(host)[0]

For some environments where the hostnames are mapped by the DNS to multiple IPs, e.g. in clouds where the IPs point to the external load balancers, it would be preferable that the client, on failing to connect to one of the IPs, would try the other ones before giving up the connection.

 

 

Issue Links

• causes: KAFKA-7755 Kubernetes - Kafka clients are resolving DNS entries only one time
• duplicates: KAFKA-2036 Consumer and broker have different networks
• links to: GitHub Pull Request #4987
• mentioned in: Page Loading...
• mentioned in: Page Loading...