Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-9311

PubSub connector

    XMLWordPrintableJSON

    Details

      Description

      I would like start adding some google cloud connectors starting with a PubSub Source. I have a basic implementation ready but I want it to be able to:

      • easily scale up (should I have it extend RichParallelSourceFunction for this?)
      • Make it easier to provide the google cloud credentials. This would require being able to send some json string / ServiceAccount to the nodes when starting up this source.

      CouldĀ this be something that would be useful for others and added to the flink connectors repo?

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                nielsbasjes Niels Basjes
                Reporter:
                Xeli Richard Deurwaarder
              • Votes:
                1 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m