Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2715

Expose PubsubSource to create UnboundedSource and utilize withMaxNumRecords from BoundedReadFromUnboundedSource

Details

    • New Feature
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • io-java-gcp

    Description

      We are ingesting from a Pubsub Read and are attempting to mimic the maxNumRecords that was available in 0.6.0. In order to do this we would need to utilize withMaxNumRecords from the BoundedReadFromUnboundedSource class. We would need to utilize the PubsubSource class to create the UnboundedSource from Pubsub. Would it be possible to expose PubsubSource? Currently what is the recommended way to create a bounded read from Pubsub with a set number of records?

      Attachments

        Activity

          People

            Unassigned Unassigned
            alevy Adam Levy
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: