Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2889 Flink runs portable pipelines
  3. BEAM-2898

Flink supports chaining/fusion of single-SDK stages

    XMLWordPrintableJSON

Details

    Description

      The Fn API supports fused stages, which avoids unnecessarily round-tripping the data over the Fn API between stages. The Flink runner should use that capability for better performance.

      Attachments

        Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. BEAM-3972 Flink runner translates batch pipelines directly by proto

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-3914 'Unzip' flattens before performing fusion

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          links to

          Web Link GitHub Pull Request #4783

          Activity

            People

              bsidhom Ben Sidhom
              herohde Henning Rohde
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 4h 50m
                  4h 50m