[FLINK-25577] Update GCS documentation

• Type: Technical Debt
• Status: Closed
• Priority: Blocker
• Resolution: Done
• Fix Version/s: 1.15.0
• Component/s: Connectors / FileSystem, Documentation
• Labels: pull-request-available

Release Note

The `flink-gs-fs-hadoop` FileSystem plugin for Google Cloud Storage (GCS) has been introduced. This allows Flink to read data from and write data to GCS via paths with the `gs://' scheme, and it provides similar functionality for GCS as, for example, the `flink-s3-fs-hadoop` provides for Amazon S3.

In particular, this plugin supports the `RecoverableWriter` interface, which allows it to be used with file sinks.

Under the hood, the `flink-gs-fs-hadoop` uses Google's `gcs-connector` Hadoop library for basic read/write operations, and it uses Google's `google-cloud-storage` library to implement `RecoverableWriter` functionality.

• Assignee: Galen Warren
• Reporter: David Morávek
• Created: 07/Jan/22 14:37
• Updated: 28/Jan/22 14:39
• Resolved: 28/Jan/22 02:48

Description

Update GCS documentation with respect to:

• flink-shaded-hadoop artifacts and hadoop version 2.8.3 that are no longer supported as of 1.15
• The recoverable writer new feature
  https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/filesystems/gcs/

Issue Links

• is related to: FLINK-17685 Remove flink-shaded-hadoop-2-parent and submodules
• is related to: FLINK-25224 Upgrade the minimal supported hadoop version to 2.8.5
• relates to: FLINK-11838 Create RecoverableWriter for GCS
• links to: GitHub Pull Request #18430