[HADOOP-10643] Add NativeS3Fs that delegates calls from FileContext apis to native s3 fs implementation

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.4.0
• Component/s: fs/s3
• Assignee: Sumit Kumar
• Reporter: Sumit Kumar
• Created: 30/May/14 01:10
• Updated: 12/May/16 19:36
• Resolved: 20/Jan/16 19:18

Description

The new set of file system related apis (FileContext/AbstractFileSystem) already support local filesytem, hdfs, viewfs) however they don't support s3n. This patch is to add that support using configurations like

fs.AbstractFileSystem.s3n.impl = org.apache.hadoop.fs.s3native.NativeS3Fs

This patch however doesn't provide a new implementation, instead relies on DelegateToFileSystem abstract class to delegate all calls from FileContext apis for s3n to the NativeS3FileSystem implementation.

Issue Links

• is related to: HADOOP-11262 Enable YARN to use S3A