[HDFS-13572] [umbrella] Non-blocking HDFS Access for H3

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: fs async
• Assignee: Duo Zhang
• Reporter: Michael Stack
• Created: 16/May/18 04:28
• Updated: 13/Jun/18 01:07

Description

An umbrella JIRA for supporting non-blocking HDFS access in h3.

This issue has provenance in the stalled HDFS-9924 but would like to vault over what was going on over there, in particular, focus on an async API for hadoop3+ unencumbered by worries about how to make it work in hadoop2.

Let me post a WIP design. Would love input/feedback (We make mention of the HADOOP-12910 call for spec but as future work – hopefully thats ok). Was thinking of cutting a feature branch if all good after a bit of chat.

Issue Links

• is related to: HDFS-9924 [umbrella] Nonblocking HDFS Access
• links to: Design Doc

Sub-Tasks

• Implement basic async rpc client: Resolved
• Implement the mkdir API for AsyncDistributedFileSystem: Open
• Add authentication support for async rpc: Open
• Add retry support for async rpc: Open
• Implement the FileSystemLinkResolver in an async way: Open