[HDFS-249] RPC support for large data transfers.

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Raghu Angadi
• Created: 09/Oct/08 21:50
• Updated: 20/Jun/09 07:42

Description

Currently HDFS has a socket level protocol for serving HDFS data to clients. Clients do not use RPCs to read or write data. Fundamentally there is no reason why this data transfer can not use RPCs.

This jira is place holder for any porting Datanode transfers to RPC. This topic has been discussed in varying detail many times, the latest being in the context of HADOOP-3856. There are quite a few issues to be resolved both at API level and at implementation level.

We should probably copy some of the comments from HADOOP-3856 to here.

Issue Links

• relates to: HDFS-223 Asynchronous IO Handling in Hadoop and HDFS