[FLINK-32877] Support for HTTP connect and timeout options while writes in GCS connector

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Done
• Affects Version/s: 1.15.3, 1.16.2, 1.17.1, 1.19.0, 1.18.1
• Fix Version/s: 1.20.0
• Component/s: Connectors / FileSystem
• Labels: pull-request-available
• Assignee: Ravi Singh
• Reporter: Jayadeep Jayaraman
• Created: 16/Aug/23 02:46
• Updated: 26/Apr/24 09:10
• Resolved: 26/Apr/24 09:10

Description

The current GCS connector uses the gcs java storage library and bypasses the hadoop gcs connector which supports multiple http options. There are situations where GCS takes longer to provide a response for a PUT operation than the default value.

This change will allow users to customize their connect time and read timeout based on their application

Issue Links

• is related to: FLINK-35232 Support for retry settings on GCS connector
• links to: GitHub Pull Request #23226
• links to: GitHub Pull Request #23226
• links to: GitHub Pull Request #24673