Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18477 Über-jira: S3A Hadoop 3.3.9 features
  3. HADOOP-16134

Add S3AWriteOpContext for write ops; pass in statistics and other settings

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.0
    • None
    • fs/s3
    • None

    Description

      As discussed in HADOOP-16090; having an S3AWriteOpContext to match the read context lets us do some interesting things

      • if we record the state of the file (is this an overwrite)? we'll know not to bother with deleting any parent dir markers (Assumption: there are none(
      • If a check for a parent dir was made (which we don't currently do, but...) then iff that was an empty dir marker, we'd know to only delete that marker and not go further up the tree.

      Attachments

        Issue Links

          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-16456 Refactor the S3A codebase into a more maintainable and testable form

          • Major - Major loss of function.
          • Open
          relates to

          Sub-task - The sub-task of the issue HADOOP-16090 S3A Client to add explicit support for versioned stores

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #515

          Activity

            People

              Unassigned Unassigned
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: