Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2988

PubSub subscriptions automatically created in Python DirectRunner not reliably cleaned up

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • sdk-py-core
    • None

    Description

      In the Python DirectRunner, we attempt to garbage-collect automatically-created PubSub subscriptions here (https://github.com/apache/beam/blob/446f311746b74bdfb420ba71d76097d683fde9a1/sdks/python/apache_beam/runners/direct/transform_evaluator.py#L370). However, this mechanism may not succeed, since it is called on the _del_ method when other references may have already been garbage-collected. We should further investigate the mechanism here and attempt to make it more reliable.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ccy Charles Chen
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: