Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-562

DoFn Reuse: Add new DoFn setup and teardown to python SDK

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Triage Needed
    • P2
    • Resolution: Done
    • None
    • 2.14.0
    • sdk-py-core

    Description

      Java SDK added setup and teardown methods to the DoFns. This makes DoFns reusable and provide performance improvements. Python SDK should add support for these new DoFn methods:

      Proposal doc: https://docs.google.com/document/d/1LLQqggSePURt3XavKBGV7SZJYQ4NW8yCu63lBchzMRk/edit?ts=5771458f#

      Attachments

        Issue Links

          Blocked

          New Feature - A new feature of the product, which has yet to be developed. BEAM-563 DoFn Reuse: Update DirectRunner to support setup and teardown

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-6746 Support DoFn.setup and DoFn.teardown in Python

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          links to

          Web Link GitHub Pull Request #7994

          Activity

            People

              myffical@gmail.com Yifan Mai
              altay Ahmet Altay
              Votes:
              2 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 11.5h
                  11.5h