[SPARK-31883] Fix "curl: (60) SSL certificate problem: certificate has expired" in Jenkins

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.4.6, 3.0.0, 3.1.0
• Component/s: Project Infra
• Assignee: Unassigned
• Reporter: Dongjoon Hyun
• Created: 01/Jun/20 04:38
• Updated: 02/Jun/20 00:05

Description

*BRANCH-2.4*

• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.4-test-maven-hadoop-2.6/892/console

+ build/mvn -DzincPort=3313 -DskipTests -Phadoop-2.6 -Pyarn -Phive -Phive-thriftserver -Pkinesis-asl -Pmesos clean package
exec: curl -s -L https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
exec: curl -s -L https://downloads.lightbend.com/scala/2.11.12/scala-2.11.12.tgz

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
build/mvn: line 137: cd: /home/jenkins/workspace/spark-branch-2.4-test-maven-hadoop-2.6/build/scala-2.11.12/bin/../lib: No such file or directory
build/mvn: line 138: cd: /home/jenkins/workspace/spark-branch-2.4-test-maven-hadoop-2.6/build/scala-2.11.12/bin/../lib: No such file or directory
build/mvn: line 161: /home/jenkins/workspace/spark-branch-2.4-test-maven-hadoop-2.6/build/zinc-0.3.15/bin/zinc: No such file or directory
build/mvn: line 163: /home/jenkins/workspace/spark-branch-2.4-test-maven-hadoop-2.6/build/zinc-0.3.15/bin/zinc: No such file or directory

*BRANCH-3.0*

• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-3.0-test-maven-hadoop-2.7-hive-1.2/380/consoleFull

+ build/mvn -DzincPort=3110 -DskipTests -Phadoop-2.7 -Pyarn -Phive -Phive-1.2 -Phive-thriftserver -Pkinesis-asl -Pmesos clean package
exec: curl -s -L https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
exec: curl -s -L https://downloads.lightbend.com/scala/2.12.10/scala-2.12.10.tgz

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
build/mvn: line 138: cd: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-1.2/build/scala-2.12.10/bin/../lib: No such file or directory
build/mvn: line 139: cd: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-1.2/build/scala-2.12.10/bin/../lib: No such file or directory
build/mvn: line 156: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-1.2/build/zinc-0.3.15/bin/zinc: No such file or directory
build/mvn: line 158: /home/jenkins/workspace/spark-branch-3.0-test-maven-hadoop-2.7-hive-1.2/build/zinc-0.3.15/bin/zinc: No such file or directory

*BRANCH-MASTER*

• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-2.7-hive-1.2/499/consoleFull

+ build/mvn -DzincPort=3331 -DskipTests -Phadoop-2.7 -Pyarn -Phive -Phive-1.2 -Phive-thriftserver -Pkinesis-asl -Pmesos clean package
exec: curl --silent --show-error -L https://downloads.lightbend.com/zinc/0.3.15/zinc-0.3.15.tgz
curl: (60) SSL certificate problem: certificate has expired
More details here: https://curl.haxx.se/docs/sslcerts.html

curl performs SSL certificate verification by default, using a "bundle"
 of Certificate Authority (CA) public keys (CA certs). If the default
 bundle file isn't adequate, you can specify an alternate file
 using the --cacert option.
If this HTTPS server uses a certificate signed by a CA represented in
 the bundle, the certificate verification probably failed due to a
 problem with the certificate (it might be expired, or the name might
 not match the domain name in the URL).
If you'd like to turn off curl's verification of the certificate, use
 the -k (or --insecure) option.

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
exec: curl --silent --show-error -L https://downloads.lightbend.com/scala/2.12.10/scala-2.12.10.tgz
curl: (60) SSL certificate problem: certificate has expired
More details here: https://curl.haxx.se/docs/sslcerts.html

curl performs SSL certificate verification by default, using a "bundle"
 of Certificate Authority (CA) public keys (CA certs). If the default
 bundle file isn't adequate, you can specify an alternate file
 using the --cacert option.
If this HTTPS server uses a certificate signed by a CA represented in
 the bundle, the certificate verification probably failed due to a
 problem with the certificate (it might be expired, or the name might
 not match the domain name in the URL).
If you'd like to turn off curl's verification of the certificate, use
 the -k (or --insecure) option.

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
build/mvn: line 130: cd: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-hive-1.2/build/scala-2.12.10/bin/../lib: No such file or directory
build/mvn: line 131: cd: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-hive-1.2/build/scala-2.12.10/bin/../lib: No such file or directory
build/mvn: line 148: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-hive-1.2/build/zinc-0.3.15/bin/zinc: No such file or directory
build/mvn: line 150: /home/jenkins/workspace/spark-master-test-maven-hadoop-2.7-hive-1.2/build/zinc-0.3.15/bin/zinc: No such file or directory