[HDFS-5194] Robust support for alternate FsDatasetSpi implementations

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: datanode, hdfs-client
• Assignee: David Powell
• Reporter: David Powell
• Created: 12/Sep/13 21:30
• Updated: 27/Jan/15 21:19

Description

The existing FsDatasetSpi interface is well-positioned to permit extending Hadoop to run natively on non-traditional storage architectures. Before this can be done, however, a number of gaps need to be addressed. This JIRA documents those gaps, suggests some solutions, and puts forth a sample implementation of some of the key changes needed.

Issue Links

• is related to: HDFS-2907 Make FSDataset in Datanode Pluggable

Sub-Tasks

• Expose interfaces required by FsDatasetSpi implementations: Closed
• BlockListAsLongs should take lists of Replicas rather than concrete classes: Closed
• Make hsync implementation pluggable: Closed
• Support dataset-specific choice of short circuit implementation: Open
• Fix ReplicaInputStream constructor to take InputStreams: Closed