Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4141

Data channel deadlocks when user function fails

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • Not applicable
    • Not applicable
    • sdk-go
    • None

    Description

      There is a deadlock condition in the data channel code that occurs when a user function fails while processing an element. The producer for the data channel is continuing to send information across a channel, but the intended consumer has stopped listening. Unfortunately, this channel blocks the entire data channel, blocking data for any other DoFn that might be running, causing the whole worker to deadlock.

      Attachments

        Issue Links

          Activity

            People

              wcn3 Bill Neubauer
              wcn3 Bill Neubauer
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 50m
                  2h 50m