[ZEPPELIN-884] Spark binary download failure/corrupted archive

• Type: Sub-task
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Labels: flaky-test
• Assignee: Unassigned
• Reporter: Prasad Wagle
• Created: 25/May/16 19:55
• Updated: 20/Jan/17 15:03

Description

This is Spark binary download failuer though the CI cache/ `testing/downloadSpark.sh`

https://travis-ci.org/apache/incubator-zeppelin/builds/132935311

travis_time:end:21a394f1:start=1464204778861960813,finish=1464205258482497742,duration=479620536929
travis_fold:end:install
travis_fold:start:before_script.1
travis_time:start:3a453634
$ travis_retry ./testing/downloadSpark.sh $SPARK_VER $HADOOP_VER
+MAX_DOWNLOAD_TIME_SEC=590
++dirname ./testing/downloadSpark.sh
+FWDIR=./testing
++cd ./testing/..
++pwd
+ZEPPELIN_HOME=/home/travis/build/apache/incubator-zeppelin
+SPARK_CACHE=.spark-dist
+SPARK_ARCHIVE=spark-1.6.1-bin-hadoop2.3
+export SPARK_HOME=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
+SPARK_HOME=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
+echo 'SPARK_HOME is /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3'
SPARK_HOME is /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
+[[ ! -d /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3 ]]
+mkdir -p .spark-dist
+cd .spark-dist
+[[ ! -f spark-1.6.1-bin-hadoop2.3.tgz ]]
+cp spark-1.6.1-bin-hadoop2.3.tgz ..
+cd ..
+tar zxf spark-1.6.1-bin-hadoop2.3.tgz

gzip: stdin: unexpected end of file
tar: Unexpected EOF in archive
tar: Unexpected EOF in archive
tar: Error is not recoverable: exiting now
+echo 'Unable to extract spark-1.6.1-bin-hadoop2.3.tgz'
Unable to extract spark-1.6.1-bin-hadoop2.3.tgz
+rm -rf spark-1.6.1-bin-hadoop2.3
+rm -f spark-1.6.1-bin-hadoop2.3.tgz
+set +xe

travis_time:end:3a453634:start=1464205258487517740,finish=1464205259031573705,duration=544055965
travis_fold:end:before_script.1
travis_fold:start:before_script.2
travis_time:start:22b5d9f8
$ ./testing/startSparkCluster.sh $SPARK_VER $HADOOP_VER
++dirname ./testing/startSparkCluster.sh
+FWDIR=./testing
++cd ./testing/..
++pwd
+ZEPPELIN_HOME=/home/travis/build/apache/incubator-zeppelin
+SPARK_ARCHIVE=spark-1.6.1-bin-hadoop2.3
+export SPARK_HOME=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
+SPARK_HOME=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
+echo 'SPARK_HOME is /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3'
SPARK_HOME is /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
+export SPARK_PID_DIR=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3/run
+SPARK_PID_DIR=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3/run
+mkdir -p /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3/run
+export SPARK_MASTER_PORT=7071
+SPARK_MASTER_PORT=7071
+export SPARK_MASTER_WEBUI_PORT=7072
+SPARK_MASTER_WEBUI_PORT=7072
+export SPARK_WORKER_WEBUI_PORT=8082
+SPARK_WORKER_WEBUI_PORT=8082
+/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3/sbin/start-master.sh
./testing/startSparkCluster.sh: line 58: /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3/sbin/start-master.sh: No such file or directory

travis_time:end:22b5d9f8:start=1464205259036240292,finish=1464205259046953195,duration=10712903

The command "./testing/startSparkCluster.sh $SPARK_VER $HADOOP_VER" failed and exited with 1 during .

Your build has been stopped.