Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-6139

Documentation for building / preparing Flink for MapR

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0, 1.2.1
    • Component/s: Documentation
    • Labels:
      None

      Description

      MapR users frequently bump into problems with trying to run Flink on YARN in MapR environments. We should have a document for users to reference that answers all these problems once and for all.

        Issue Links

          Activity

          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user tzulitai opened a pull request:

          https://github.com/apache/flink/pull/3582

          FLINK-6139 [doc] Documentation for running Flink with MapR

          Includes how to properly build Flink & setup job client to be able to run Flink on YARN with a MapR cluster.

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/tzulitai/flink FLINK-6139

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/flink/pull/3582.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #3582


          commit 5c8d86082a5208abb26c15b7ef02372f02882eaa
          Author: Tzu-Li (Gordon) Tai <tzulitai@apache.org>
          Date: 2017-03-21T05:54:48Z

          FLINK-6139 [doc] Documentation for running Flink with MapR


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3582 FLINK-6139 [doc] Documentation for running Flink with MapR Includes how to properly build Flink & setup job client to be able to run Flink on YARN with a MapR cluster. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tzulitai/flink FLINK-6139 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/3582.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3582 commit 5c8d86082a5208abb26c15b7ef02372f02882eaa Author: Tzu-Li (Gordon) Tai <tzulitai@apache.org> Date: 2017-03-21T05:54:48Z FLINK-6139 [doc] Documentation for running Flink with MapR
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user rmetzger commented on the issue:

          https://github.com/apache/flink/pull/3582

          I would propose to add a special "mapr" build profile to our maven files to do all the exclusions. Otherwise, the documentation looks pretty scary

          Show
          githubbot ASF GitHub Bot added a comment - Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3582 I would propose to add a special "mapr" build profile to our maven files to do all the exclusions. Otherwise, the documentation looks pretty scary
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user tzulitai commented on the issue:

          https://github.com/apache/flink/pull/3582

          @rmetzger that definitely makes sense, I'll try to include that with the PR.

          Show
          githubbot ASF GitHub Bot added a comment - Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3582 @rmetzger that definitely makes sense, I'll try to include that with the PR.
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user rmetzger commented on the issue:

          https://github.com/apache/flink/pull/3582

          Cool, thank you!

          Show
          githubbot ASF GitHub Bot added a comment - Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3582 Cool, thank you!
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user tzulitai commented on the issue:

          https://github.com/apache/flink/pull/3582

          @rmetzger I've added the "mapr" build profile to our Maven build.

          Now the build command is shortly: `mvn clean install -Pvendor-repos,mapr`. Much less daunting for users Currently, both `mapr` and `vendor-repos` must be used together.
          We could perhaps shorten this further into a single profile, by also adding the MapR repo in `mapr` profile. What do you think?

          Show
          githubbot ASF GitHub Bot added a comment - Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3582 @rmetzger I've added the "mapr" build profile to our Maven build. Now the build command is shortly: `mvn clean install -Pvendor-repos,mapr`. Much less daunting for users Currently, both `mapr` and `vendor-repos` must be used together. We could perhaps shorten this further into a single profile, by also adding the MapR repo in `mapr` profile. What do you think?
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user rmetzger commented on the issue:

          https://github.com/apache/flink/pull/3582

          I think its fine like this.

          Show
          githubbot ASF GitHub Bot added a comment - Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3582 I think its fine like this.
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user rmetzger commented on the issue:

          https://github.com/apache/flink/pull/3582

          +1 to merge

          Show
          githubbot ASF GitHub Bot added a comment - Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3582 +1 to merge
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user tzulitai commented on the issue:

          https://github.com/apache/flink/pull/3582

          Thanks for the review, merging to master and release-1.2.

          Show
          githubbot ASF GitHub Bot added a comment - Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3582 Thanks for the review, merging to master and release-1.2 .
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user asfgit closed the pull request at:

          https://github.com/apache/flink/pull/3582

          Show
          githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3582
          Show
          tzulitai Tzu-Li (Gordon) Tai added a comment - Resolved for 1.3.0 with http://git-wip-us.apache.org/repos/asf/flink/commit/09239ea Resolved for 1.2.1 with http://git-wip-us.apache.org/repos/asf/flink/commit/36cf94a

            People

            • Assignee:
              tzulitai Tzu-Li (Gordon) Tai
              Reporter:
              tzulitai Tzu-Li (Gordon) Tai
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development