Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15620 Über-jira: S3A phase VI: Hadoop 3.3 features
  3. HADOOP-16202

S3A openFile() operation to support explicit versionID, etag parameters

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.3.0
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None

      Description

      The openFile() builder API lets us add new options when reading a file

      Proposed: allowing applications to explicitly demand on. If we explicitly add the values in the S3A filestatus & located filestatus (maybe even: checksum?), then you can list a directory and. knowing those values, explicitly ask for that version of file.

      org.apache.fs.s3a.open.versionid + versionID
org.apache.fs.s3a.open.etag + etag

      setting both will be an error.

        Attachments

          Issue Links

          is related to

          Sub-task - The sub-task of the issue HADOOP-15625 S3A input stream to use etags/version number to detect changed source files

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HADOOP-16090 S3A Client to add explicit support for versioned stores

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Patch Available

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: