Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-980

Ability to configure the DAG created by Apex Runner

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 0.6.0
    • runner-apex
    • None

    Description

      The Beam pipeline is translated to an Apex DAG of operators that have names that are derived from the transforms. In case of composite transforms those look like path names. Apex lets the user configure things like memory, vcores, parallelism through properties/attributes that reference the operator names. The configuration approach needs to be documented and supplemented with an example.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-1329 Improve default resource allocation in ApexRunner

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved
          links to

          Web Link GitHub Pull Request #1850

          Activity

            People

              thw Thomas Weise
              thw Thomas Weise
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: