Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2769

Java SDK support for portable pipelines

    Details

    • Type: Improvement
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: sdk-java-core
    • Labels:

      Description

      The Java codebase should provide a way to submit a Job to a Job Service.

        Issue Links

          Activity

          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user tgroh opened a pull request:

          https://github.com/apache/beam/pull/3720

          BEAM-2769 Add a JobApiRunner

          Follow this checklist to help us incorporate your contribution quickly and easily:

          • [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects/BEAM/issues/) filed for the change (usually before you start working on it). Trivial changes like typos do not require a JIRA issue. Your pull request should address just this issue, without pulling in other changes.
          • [ ] Each commit in the pull request should have a meaningful subject line and body.
          • [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue.
          • [ ] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
          • [ ] Run `mvn clean verify` to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
          • [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).

          This is a runner that executes a Pipeline by submitting it to a JobService instance.

          Not yet tested.

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/tgroh/beam job_api_runner

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/beam/pull/3720.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #3720


          commit dd734738bc7c477c0235e30495ceeeb5b65e23f4
          Author: Thomas Groh <tgroh@google.com>
          Date: 2017-08-15T20:22:01Z

          Add PipelineOptionsTranslation

          This converts a PipelineOptions instance to and from a Protobuf Struct.

          commit 11f9df863f11e4bec32cfec9a06a8f3018f5e57b
          Author: Thomas Groh <tgroh@google.com>
          Date: 2017-08-15T20:24:21Z

          Add a JobApiRunner

          This is a runner that executes a Pipeline by submitting it to a
          JobService instance.

          Not yet tested.


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3720 BEAM-2769 Add a JobApiRunner Follow this checklist to help us incorporate your contribution quickly and easily: [ ] Make sure there is a [JIRA issue] ( https://issues.apache.org/jira/projects/BEAM/issues/ ) filed for the change (usually before you start working on it). Trivial changes like typos do not require a JIRA issue. Your pull request should address just this issue, without pulling in other changes. [ ] Each commit in the pull request should have a meaningful subject line and body. [ ] Format the pull request title like ` [BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue. [ ] Write a pull request description that is detailed enough to understand what the pull request does, how, and why. [ ] Run `mvn clean verify` to make sure basic checks pass. A more thorough check will be performed on your pull request automatically. [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement] ( https://www.apache.org/licenses/icla.pdf ). — This is a runner that executes a Pipeline by submitting it to a JobService instance. Not yet tested. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tgroh/beam job_api_runner Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3720.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3720 commit dd734738bc7c477c0235e30495ceeeb5b65e23f4 Author: Thomas Groh <tgroh@google.com> Date: 2017-08-15T20:22:01Z Add PipelineOptionsTranslation This converts a PipelineOptions instance to and from a Protobuf Struct. commit 11f9df863f11e4bec32cfec9a06a8f3018f5e57b Author: Thomas Groh <tgroh@google.com> Date: 2017-08-15T20:24:21Z Add a JobApiRunner This is a runner that executes a Pipeline by submitting it to a JobService instance. Not yet tested.

            People

            • Assignee:
              tgroh Thomas Groh
              Reporter:
              tgroh Thomas Groh
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:

                Development