Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15620 Über-jira: S3A phase VI: Hadoop 3.3 features
  3. HADOOP-16202

S3A openFile() operation to support explicit versionID, etag parameters

          Details

          • Type: Sub-task
          • Status: Open
          • Priority: Major
          • Resolution: Unresolved
          • Affects Version/s: 3.3.0
          • Fix Version/s: None
          • Component/s: fs/s3
          • Labels:
            None

            Description

            The openFile() builder API lets us add new options when reading a file

            Proposed: allowing applications to explicitly demand on. If we explicitly add the values in the S3A filestatus & located filestatus (maybe even: checksum?), then you can list a directory and. knowing those values, explicitly ask for that version of file.

            org.apache.fs.s3a.open.versionid + versionID
org.apache.fs.s3a.open.etag + etag

            setting both will be an error.

              Attachments

                Issue Links

                is related to

                Sub-task - The sub-task of the issue HADOOP-15625 S3A input stream to use etags/version number to detect changed source files

                • Major - Major loss of function.
                • Resolved

                Sub-task - The sub-task of the issue HADOOP-16090 S3A Client to add explicit support for versioned stores

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Patch Available

                  Activity

                    People

                    • Assignee:
                      Unassigned
                      Reporter:
                      stevel@apache.org Steve Loughran
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      1 Start watching this issue

                      Dates

                      • Created:
                        Updated: