Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2982

PubSubIO.readMessages().fromSubscription(...) doesn't work with ValueProvider

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.2.0
    • io-java-gcp
    • None

    Description

      Originally reported on Stack Overflow:

      https://stackoverflow.com/questions/46360584/apache-beam-template-runtime-context-error

      In the `PubsubUnboundedSource#expand` method we create the PubsubSource:

      https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubUnboundedSource.java#L1399

      Creating the PubsubSource calls `getSubscription` which attempts to get the value out of a value provider.

      To support templatization, the PubsubSource needs to take the ValueProvider, and only get the subscription out at pipeline execution time.

      Attachments

        Issue Links

          Activity

            People

              tgroh Thomas Groh
              bchambers Ben Chambers
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment