Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6166

Allow Runners to configure parallelism of GrpcStateService

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • runner-core
    • None

    Description

      GrpcStateService by default uses a non-thread-safe OutboundServer which has led to problem with asynchronously sending data to it. The sending is now changed to be done synchronously but it could be done asynchronously if OutboundObserverFactory was used.

      Depending on the Runner, asynchronicity may or may not be desired. We should provide a way to configure parallelism of GrpcStateService for each Runner.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. BEAM-6111 org.apache.beam.runners.flink.PortableTimersExecutionTest is very flakey 40/50 runs failed

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              mxm Maximilian Michels
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: