[HADOOP-19256] S3A: Support S3 Conditional Writes

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: fs/s3
• Labels: pull-request-available
• Target Version/s: 3.4.2
• Assignee: Unassigned
• Reporter: Ahmar Suhail
• Created: 21/Aug/24 18:07
• Updated: 03/Dec/24 13:39

Description

S3 Conditional Write (Put-if-absent) capability is now generally available - https://aws.amazon.com/about-aws/whats-new/2024/08/amazon-s3-conditional-writes/

 

S3A should allow passing in this put-if-absent header to prevent over writing of files. 

There is a feature branch for this: HADOOP-19256-s3-conditional-writes

Issue Links

• relates to: HADOOP-19251 Add Options.Rename.THROW_NON_ATOMIC
• links to: Adopting S3 Conditional Writes in the S3A Connector
• links to: GitHub Pull Request #7011
• links to: GitHub Pull Request #7015
• links to: GitHub Pull Request #7033