Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7997

Create a single docker container for a pipeline instead of creating one for each worker.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Not A Problem
    • None
    • 2.15.0
    • sdk-py-core

    Description

      With --direct_nun_workers option, current implementation creates a container for each worker. We should change this behavior to creating a container for a pipeline and handles multi workers inside of the container.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-3645 Support multi-process execution on the FnApiRunner

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Triage Needed

          Activity

            People

              hannahjiang Hannah Jiang
              hannahjiang Hannah Jiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: