[FLINK-13768] Update documentation regarding `path style access` for S3 filesystem implementations

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Component/s: Documentation
• Labels: documentation-update pull-request-available
• Assignee: Unassigned
• Reporter: Achyuth Narayan Samudrala
• Created: 19/Aug/19 05:37
• Updated: 19/Nov/19 13:53
• Resolved: 19/Nov/19 13:53

Description

The documentation related to various properties that can be provided for the s3 sink is not very informative. According to the code in flink-s3-fs-base/flink-s3-fs-hadoop, any property specified as s3.<some-property> is transformed to fs.s3a.<some-property>.

 

When interacting with s3 compatible file systems such as CEPH/Minio, default configuration properties might not be sufficient. One such property is the fs.s3a.path.style.access. This property enables different modes of access to the s3 buckets. By default if this property is not set, virtual host style addressing is used. The documentation should mention how this property can be passed on as a flink conf property.

Issue Links

• links to: GitHub Pull Request #9479