Description
Add some options in createFile() for S3A specifically.
I think we need something for "put-only" where none of the existence checks nor cleanup checks are made when s3guard == off. That is: no HEAD/LIST first, no DELETE parents after. Only the PUT is done.
This is
- faster
- lower cost
- avoids 404's being cached in load balancers and so create inconsistency
It does rely on the caller knowing what they are doing else you end up in a mess, but since the s3a committers use WriteOperationsHelper for this exact operation, we should open it up to others who also know what they are doing.
Attachments
Issue Links
- is part of
-
HADOOP-17833 Improve Magic Committer Performance
-
- Resolved
-