Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-6139

Documentation for building / preparing Flink for MapR

        Details

        • Type: New Feature
        • Status: Resolved
        • Priority: Major
        • Resolution: Fixed
        • Affects Version/s: None
        • Fix Version/s: 1.3.0, 1.2.1
        • Component/s: Documentation
        • Labels:
          None

          Description

          MapR users frequently bump into problems with trying to run Flink on YARN in MapR environments. We should have a document for users to reference that answers all these problems once and for all.

            Issue Links

            links to

            Web Link GitHub Pull Request #3582

              Activity

              Ascending order - Click to sort in descending order
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              GitHub user tzulitai opened a pull request:

              https://github.com/apache/flink/pull/3582

              FLINK-6139 [doc] Documentation for running Flink with MapR

              Includes how to properly build Flink & setup job client to be able to run Flink on YARN with a MapR cluster.

              You can merge this pull request into a Git repository by running:

              $ git pull https://github.com/tzulitai/flink FLINK-6139

              Alternatively you can review and apply these changes as the patch at:

              https://github.com/apache/flink/pull/3582.patch

              To close this pull request, make a commit to your master/trunk branch
              with (at least) the following in the commit message:

              This closes #3582

              commit 5c8d86082a5208abb26c15b7ef02372f02882eaa
              Author: Tzu-Li (Gordon) Tai <tzulitai@apache.org>
              Date: 2017-03-21T05:54:48Z

              FLINK-6139 [doc] Documentation for running Flink with MapR

              Show
              githubbot ASF GitHub Bot added a comment - GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3582 FLINK-6139 [doc] Documentation for running Flink with MapR Includes how to properly build Flink & setup job client to be able to run Flink on YARN with a MapR cluster. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tzulitai/flink FLINK-6139 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/3582.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3582 commit 5c8d86082a5208abb26c15b7ef02372f02882eaa Author: Tzu-Li (Gordon) Tai <tzulitai@apache.org> Date: 2017-03-21T05:54:48Z FLINK-6139 [doc] Documentation for running Flink with MapR
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user rmetzger commented on the issue:

              https://github.com/apache/flink/pull/3582

              I would propose to add a special "mapr" build profile to our maven files to do all the exclusions. Otherwise, the documentation looks pretty scary

              Show
              githubbot ASF GitHub Bot added a comment - Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3582 I would propose to add a special "mapr" build profile to our maven files to do all the exclusions. Otherwise, the documentation looks pretty scary
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user tzulitai commented on the issue:

              https://github.com/apache/flink/pull/3582

              @rmetzger that definitely makes sense, I'll try to include that with the PR.

              Show
              githubbot ASF GitHub Bot added a comment - Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3582 @rmetzger that definitely makes sense, I'll try to include that with the PR.
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user rmetzger commented on the issue:

              https://github.com/apache/flink/pull/3582

              Cool, thank you!

              Show
              githubbot ASF GitHub Bot added a comment - Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3582 Cool, thank you!
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user tzulitai commented on the issue:

              https://github.com/apache/flink/pull/3582

              @rmetzger I've added the "mapr" build profile to our Maven build.

              Now the build command is shortly: `mvn clean install -Pvendor-repos,mapr`. Much less daunting for users Currently, both `mapr` and `vendor-repos` must be used together.
              We could perhaps shorten this further into a single profile, by also adding the MapR repo in `mapr` profile. What do you think?

              Show
              githubbot ASF GitHub Bot added a comment - Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3582 @rmetzger I've added the "mapr" build profile to our Maven build. Now the build command is shortly: `mvn clean install -Pvendor-repos,mapr`. Much less daunting for users Currently, both `mapr` and `vendor-repos` must be used together. We could perhaps shorten this further into a single profile, by also adding the MapR repo in `mapr` profile. What do you think?
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user rmetzger commented on the issue:

              https://github.com/apache/flink/pull/3582

              I think its fine like this.

              Show
              githubbot ASF GitHub Bot added a comment - Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3582 I think its fine like this.
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user rmetzger commented on the issue:

              https://github.com/apache/flink/pull/3582

              +1 to merge

              Show
              githubbot ASF GitHub Bot added a comment - Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3582 +1 to merge
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user tzulitai commented on the issue:

              https://github.com/apache/flink/pull/3582

              Thanks for the review, merging to master and release-1.2.

              Show
              githubbot ASF GitHub Bot added a comment - Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3582 Thanks for the review, merging to master and release-1.2 .
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user asfgit closed the pull request at:

              https://github.com/apache/flink/pull/3582

              Show
              githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3582
              Hide
              Permalink
              tzulitai Tzu-Li (Gordon) Tai added a comment -

              Resolved for 1.3.0 with http://git-wip-us.apache.org/repos/asf/flink/commit/09239ea

              Resolved for 1.2.1 with http://git-wip-us.apache.org/repos/asf/flink/commit/36cf94a

              Show
              tzulitai Tzu-Li (Gordon) Tai added a comment - Resolved for 1.3.0 with http://git-wip-us.apache.org/repos/asf/flink/commit/09239ea Resolved for 1.2.1 with http://git-wip-us.apache.org/repos/asf/flink/commit/36cf94a

                People

                • Assignee:
                  tzulitai Tzu-Li (Gordon) Tai
                  Reporter:
                  tzulitai Tzu-Li (Gordon) Tai
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  2 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development