Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2891

Spark runs portable pipelines

    XMLWordPrintableJSON

Details

    Description

      Spark should run pipelines using the full portability API as currently defined:

      https://s.apache.org/beam-fn-api
      https://s.apache.org/beam-runner-api
      https://s.apache.org/beam-job-api
      https://s.apache.org/beam-fn-api-container-contract

      This issue tracks its adoption of the portability framework. New Fn API and other features will be tracked separately.

      Attachments

        Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. BEAM-6296 Support Python Spark Runner

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-2896 Portability milestone: wordcount runs everywhere

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Triage Needed
          There are no Sub-Tasks for this issue.

          Activity

            People

              Unassigned Unassigned
              herohde Henning Rohde
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 40m
                  2h 40m