[SPARK-25254] docker-image-tool should allow not building images for R and Python

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 2.4.0
• Component/s: Build
• Assignee: Unassigned
• Reporter: Chaoran Yu
• Created: 27/Aug/18 19:09
• Updated: 12/Feb/19 18:58
• Resolved: 12/Feb/19 18:58

Description

Suppose a user does not need R, so he builds Spark using make-distribution.sh without R to generate a runnable distribution. 

Then he runs docker-image-tool.sh to generate Docker images based off of the distribution just produced in the previous step. And then docker-image-tool.sh fails because the R image fails to build. This is counter-intuitive.

docker-image-tool.sh builds three images: regular, R and Python. make-distribution.sh allows users to specify whether to build Spark with R or Python, so should docker-image-tool.sh.

Issue Links

• duplicates: SPARK-25957 Skip building spark-r docker image if spark distribution does not have R support