[ARROW-12719] [C++][Python] pyarrow.fs.S3FileSystem pass extra kwargs i.e ACL

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 5.0.0
• Component/s: C++, Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/10251#issuecomment-832975809
• Assignee: Antoine Pitrou
• Reporter: Ryan Haarmann
• Created: 10/May/21 16:16
• Updated: 11/Jan/23 08:28
• Resolved: 02/Jun/21 16:10

Description

Is there a way to set specific ACL args to the new written files via the S3FileSystem? We have a situation where the writer/read role groups do not have access unless specified during the write process.

Example of how we update with `s3fs`:

s3fs.S3FileSystem(
 s3_additional_kwargs={'ACL': 'bucket-owner-full-control'}
)

or with `boto`:

extra_args.update(\{"ACL": "bucket-owner-full-control"})
boto3.s3.transfer.S3Transfer(...).upload_file(extra_args=extra_args)

or

s3.Object(my_bucket_name, my_key_path).put(Body=my_body, ACL='bucket-owner-full-control')

Issue Links

• links to: GitHub Pull Request #10439