Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7348

Option to expire SDK worker environments

    XMLWordPrintableJSON

    Details

      Description

      We discovered that Python SDK workers are susceptible to memory leaks that are quite hard to identify and/or fix. This becomes an issue in streaming pipelines, where the workers run "forever". It would be good if the user has an option to recycle the workers when there is no other practical way to address (slow) resource leaks.

        Attachments

          Activity

            People

            • Assignee:
              thw Thomas Weise
              Reporter:
              thw Thomas Weise
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 2h 40m
                2h 40m