[SPARK-15395] Use getHostString to create RpcAddress

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0, 1.6.1
• Fix Version/s: 2.0.0
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 19/May/16 00:27
• Updated: 17/Jun/16 20:35
• Resolved: 19/May/16 03:16

Description

Right now the netty RPC uses `InetSocketAddress.getHostName` to create `RpcAddress` for network events. If we use an IP address to connect, then the RpcAddress's host will be a host name (if the reverse lookup successes) instead of the IP address. However, some places need to compare the original IP address and the RpcAddress in `onDisconnect` (e.g., CoarseGrainedExecutorBackend), and this behavior will make the check incorrect.

The correct way is using `getHostString`.

Issue Links

• breaks: SPARK-16017 YarnClientSchedulerBackend now registers backends as IPs instead of Hostnames which causes all tasks to run with RACK_LOCAL locality.
• links to: [Github] Pull Request #13185 (zsxwing)
• links to: [Github] Pull Request #13196 (zsxwing)