Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15620 Über-jira: S3A phase VI: Hadoop 3.3 features
  3. HADOOP-16134

Add S3AWriteOpContext for write ops; pass in statistics and other settings

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.3.0
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None

      Description

      As discussed in HADOOP-16090; having an S3AWriteOpContext to match the read context lets us do some interesting things

      • if we record the state of the file (is this an overwrite)? we'll know not to bother with deleting any parent dir markers (Assumption: there are none(
      • If a check for a parent dir was made (which we don't currently do, but...) then iff that was an empty dir marker, we'd know to only delete that marker and not go further up the tree.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: