Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance
  3. HADOOP-10643

Add NativeS3Fs that delegates calls from FileContext apis to native s3 fs implementation

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.4.0
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None

      Description

      The new set of file system related apis (FileContext/AbstractFileSystem) already support local filesytem, hdfs, viewfs) however they don't support s3n. This patch is to add that support using configurations like

      fs.AbstractFileSystem.s3n.impl = org.apache.hadoop.fs.s3native.NativeS3Fs

      This patch however doesn't provide a new implementation, instead relies on DelegateToFileSystem abstract class to delegate all calls from FileContext apis for s3n to the NativeS3FileSystem implementation.

        Attachments

        1. HADOOP-10643.patch
          6 kB
          Sumit Kumar

        Issue Links

          Activity

            People

            • Assignee:
              ksumit Sumit Kumar
              Reporter:
              ksumit Sumit Kumar

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment