Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-1981 [Umbrella] Fix all flaky tests
  3. ZEPPELIN-884

Spark binary download failure/corrupted archive

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      This is Spark binary download failuer though the CI cache/ `testing/downloadSpark.sh`

      https://travis-ci.org/apache/incubator-zeppelin/builds/132935311

      travis_time:end:21a394f1:start=1464204778861960813,finish=1464205258482497742,duration=479620536929
      travis_fold:end:install
      travis_fold:start:before_script.1
      travis_time:start:3a453634
      $ travis_retry ./testing/downloadSpark.sh $SPARK_VER $HADOOP_VER
      +MAX_DOWNLOAD_TIME_SEC=590
      ++dirname ./testing/downloadSpark.sh
      +FWDIR=./testing
      ++cd ./testing/..
      ++pwd
      +ZEPPELIN_HOME=/home/travis/build/apache/incubator-zeppelin
      +SPARK_CACHE=.spark-dist
      +SPARK_ARCHIVE=spark-1.6.1-bin-hadoop2.3
      +export SPARK_HOME=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
      +SPARK_HOME=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
      +echo 'SPARK_HOME is /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3'
      SPARK_HOME is /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
      +[[ ! -d /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3 ]]
      +mkdir -p .spark-dist
      +cd .spark-dist
      +[[ ! -f spark-1.6.1-bin-hadoop2.3.tgz ]]
      +cp spark-1.6.1-bin-hadoop2.3.tgz ..
      +cd ..
      +tar zxf spark-1.6.1-bin-hadoop2.3.tgz

      gzip: stdin: unexpected end of file
      tar: Unexpected EOF in archive
      tar: Unexpected EOF in archive
      tar: Error is not recoverable: exiting now
      +echo 'Unable to extract spark-1.6.1-bin-hadoop2.3.tgz'
      Unable to extract spark-1.6.1-bin-hadoop2.3.tgz
      +rm -rf spark-1.6.1-bin-hadoop2.3
      +rm -f spark-1.6.1-bin-hadoop2.3.tgz
      +set +xe

      travis_time:end:3a453634:start=1464205258487517740,finish=1464205259031573705,duration=544055965
      travis_fold:end:before_script.1
      travis_fold:start:before_script.2
      travis_time:start:22b5d9f8
      $ ./testing/startSparkCluster.sh $SPARK_VER $HADOOP_VER
      ++dirname ./testing/startSparkCluster.sh
      +FWDIR=./testing
      ++cd ./testing/..
      ++pwd
      +ZEPPELIN_HOME=/home/travis/build/apache/incubator-zeppelin
      +SPARK_ARCHIVE=spark-1.6.1-bin-hadoop2.3
      +export SPARK_HOME=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
      +SPARK_HOME=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
      +echo 'SPARK_HOME is /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3'
      SPARK_HOME is /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3
      +export SPARK_PID_DIR=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3/run
      +SPARK_PID_DIR=/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3/run
      +mkdir -p /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3/run
      +export SPARK_MASTER_PORT=7071
      +SPARK_MASTER_PORT=7071
      +export SPARK_MASTER_WEBUI_PORT=7072
      +SPARK_MASTER_WEBUI_PORT=7072
      +export SPARK_WORKER_WEBUI_PORT=8082
      +SPARK_WORKER_WEBUI_PORT=8082
      +/home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3/sbin/start-master.sh
      ./testing/startSparkCluster.sh: line 58: /home/travis/build/apache/incubator-zeppelin/spark-1.6.1-bin-hadoop2.3/sbin/start-master.sh: No such file or directory

      travis_time:end:22b5d9f8:start=1464205259036240292,finish=1464205259046953195,duration=10712903
      
      The command "./testing/startSparkCluster.sh $SPARK_VER $HADOOP_VER" failed and exited with 1 during .

      Your build has been stopped.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              prasadwagle Prasad Wagle
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: