[BIGTOP-3127] spark smoke-test fails in bigtop 1.3

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.3.0
• Component/s: spark, tests
• Assignee: Unassigned
• Reporter: Guodong Xu
• Created: 07/Jan/19 08:49
• Updated: 01/Apr/24 02:32

Description

In Bigtop 1.3, when smoke-tests 'spark' using docker containers, it fails to run. Log report says: "> undeclared env variable: SPARK_HOME"

Steps to reproduce:

1. create a local 3-node containers cluster
   • $ cd provisioner/docker/
   • $ ./docker-hadoop.sh -C smoketests-spark_centos-7.yaml -c 3
2. run smoke tests,
   • $ ./docker-hadoop.sh -s
3. check the output log, it reports failure:

:bigtop-tests:smoke-tests:spark:test (Thread[Task worker for ':' Thread 19,5,main]) started.
:bigtop-tests:smoke-tests:spark:test
Putting task artifact state for task ':bigtop-tests:smoke-tests:spark:test' into context took 0.0 secs.
Up-to-date check for task ':bigtop-tests:smoke-tests:spark:test' took 0.035 secs. It is not up-to-date because:
No history is available.
:bigtop-tests:smoke-tests:spark:test FAILED
:bigtop-tests:smoke-tests:spark:test (Thread[Task worker for ':' Thread 19,5,main]) completed. Took 0.065 secs.

FAILURE: Build failed with an exception.

• Where:
  Build file '/bigtop-home/bigtop-tests/smoke-tests/build.gradle' line: 26
• What went wrong:
  Execution failed for task ':bigtop-tests:smoke-tests:spark:test'.
  > undeclared env variable: SPARK_HOME