[FLINK-31856] Add support for Opensearch Connector REST client customization

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: opensearch-1.0.0
• Fix Version/s: opensearch-1.1.0, opensearch-1.0.2
• Component/s: Connectors / Opensearch
• Labels: pull-request-available
• Assignee: Andriy Redko
• Reporter: Michael Hempel-Jørgensen
• Created: 19/Apr/23 14:24
• Updated: 01/Feb/24 10:24
• Resolved: 13/Jun/23 16:53

Description

It is not currently possible to customise the Opensearch REST client in all of the connectors.

We are currently using the using the OpensearchSink in connector/opensearch/sink/OpensearchSink.java and need to be able to authenticate/authorise with Opensearch using OAuth2 and therefore need to be able to pass a bearer token to the bulk index calls.

The access token will expire and change during the jobs lifetime it must be possible to handle this, i.e. giving a token at when building the sink is not enough.

For reference see the mailing list discussion: https://lists.apache.org/thread/9rvwhzjwzm6yq9mg481sdxqx9nqr1x5g

Issue Links

• links to: GitHub Pull Request #24
• links to: GitHub Pull Request #26