[FLINK-9311] Add a Google Cloud PubSub connector

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.9.0
• Component/s: Connectors / Google Cloud PubSub
• Labels: pull-request-available
• Assignee: Niels Basjes
• Reporter: Richard Deurwaarder
• Created: 07/May/18 18:34
• Updated: 22/Jul/20 07:39
• Resolved: 05/Jul/19 12:50

Description

I would like start adding some google cloud connectors starting with a PubSub Source. I have a basic implementation ready but I want it to be able to:

• easily scale up (should I have it extend RichParallelSourceFunction for this?)
• Make it easier to provide the google cloud credentials. This would require being able to send some json string / ServiceAccount to the nodes when starting up this source.

Could this be something that would be useful for others and added to the flink connectors repo?

Issue Links

• is related to: FLINK-13083 Various improvements PubSub Connector
• links to: GitHub Pull Request #6248
• links to: GitHub Pull Request #6594