Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12636

Windowing transform not working for sdk-go on Dataflow?

Details

    • Bug
    • Status: Resolved
    • P3
    • Resolution: Information Provided
    • 2.31.0
    • Missing
    • runner-dataflow, sdk-go
    • None

    Description

      Hi, I'm trying to run the example windowed_wordcount on Dataflow but it doesn't seems to be working.

      When I try to run it, the only error I get from the logs in Dataflow is "Error processing pipeline". When I change the example to not use windowing all works fine.

      The version of the SDK I'm using is 2.31.0. Tried up to 2.26.0 and all have the same behaviour.

      And I'm running the example with

      go run main.go --runner=dataflow --region=europe-west1 --project=<project> --staging_location=gs://bucket/path --temp_location=gs://bucket/path --max_num_workers=1
      

      Also tried the with

      go run main.go --runner=dataflow --region=europe-west1 --project=<project> --staging_location=gs://bucket/path --temp_location=gs://bucket/path --max_num_workers=1 -worker_harness_container_image=apache/beam_go_sdk:latest --experiments=use_runner_v2
      

      Is this actually a bug or am I make some mistake running the example?

       

       

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            cprates Claudio Prates
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: