Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10318

Add option to build Hadoop-free job image to build.sh

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.6.0
    • Fix Version/s: None
    • Component/s: Deployment / Docker
    • Labels:
      None

      Description

      When building a Job-specific image from a release via flink-container/docker/build.sh, we require to specify a Hadoop version:

      ./build.sh
        --job-jar flink-job.jar
        --from-release
        --flink-version 1.6.0
        --hadoop-version 2.8 # <- currently required
        --scala-version 2.11
        --image-name flink-job
      

      I think for many users a Hadoop-free build is a good default. We should consider supporting this out of the box with the build.sh script.

      The current work around would be to manually download the Hadoop-free release and build with the --from-archive flag.

      Another alternative would be to drop the from-release option and document how to build from an archive with links to the downloads.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              uce Ufuk Celebi
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: