[FLINK-10318] Add option to build Hadoop-free job image to build.sh

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Implemented
• Affects Version/s: 1.6.0
• Component/s: flink-docker
• Assignee: Unassigned
• Reporter: Ufuk Celebi
• Created: 11/Sep/18 09:44
• Updated: 07/Aug/20 11:11
• Resolved: 07/Aug/20 11:11

Description

When building a Job-specific image from a release via flink-container/docker/build.sh, we require to specify a Hadoop version:

./build.sh
  --job-jar flink-job.jar
  --from-release
  --flink-version 1.6.0
  --hadoop-version 2.8 # <- currently required
  --scala-version 2.11
  --image-name flink-job

I think for many users a Hadoop-free build is a good default. We should consider supporting this out of the box with the build.sh script.

The current work around would be to manually download the Hadoop-free release and build with the --from-archive flag.

Another alternative would be to drop the from-release option and document how to build from an archive with links to the downloads.