[HADOOP-8198] Support multiple network interfaces

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: io, performance
• Assignee: Eli Collins
• Reporter: Eli Collins
• Created: 22/Mar/12 05:56
• Updated: 30/Dec/14 20:13

Description

Hadoop does not currently utilize multiple network interfaces, which is a common user request, and important in enterprise environments. This jira covers a proposal for enhancements to Hadoop so it better utilizes multiple network interfaces. The primary motivation being improved performance, performance isolation, resource utilization and fault tolerance. The attached design doc covers the high-level use cases, requirements, a proposal for trunk/0.23, discussion on related features, and a proposal for Hadoop 1.x that covers a subset of the functionality of the trunk/0.23 proposal.

Issue Links

• incorporates: HDFS-3140 Support multiple network interfaces
• incorporates: MAPREDUCE-4168 Support multiple network interfaces
• relates to: HADOOP-6867 Using socket address for datanode registry breaks multihoming
• relates to: HDFS-1379 Multihoming brokenness in HDFS
• relates to: HADOOP-6210 Bind Hadoop RPC outgoing to a specific nic
• relates to: HADOOP-6364 add a 'hostname' or 'identity' parameter

Sub-Tasks

• Common side of HDFS-3148: Closed
• Update commons-net version to 3.1: Closed