Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-10040

TestPubsubSignal not signalling success w/ Dataflow Runner

Details

    • Bug
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • test-failures
    • None

    Description

      The issue with FhirIOReadIT seems to be some misuse of TestPubsubSignal
      Example Job clearly has the expected >2000 elements added to the "waitForAnyMessage" task
      but the success signal never gets published to the results topic.

      Notably there are job level warnings about metric descriptors and warnings in shuffle logs which warns:

      "Update range task returned 'invalid argument'. Assuming lost lease for work with id 5061980071068333770 (expiration time: 1589940982000, now: 1589940923590, full status: INVALID_ARGUMENT: Http(400) Bad Request). For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors."

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              data-runner0 Jacob Ferriero
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m