[BIGTOP-2676] Smoke test fails on Spark 2

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Component/s: spark, tests
• Assignee: Kengo Seki
• Reporter: Kengo Seki
• Created: 23/Jan/17 13:26
• Updated: 29/Mar/17 18:46
• Resolved: 25/Jan/17 00:42

Description

./gradlew bigtop-tests:smoke-tests:spark:test -Psmoke.tests --info fails with the following error on spark 2.x:

    17/01/23 12:55:05 ERROR itest.JarContent: No /usr/lib/spark/lib exists. Check your installation.

It seems that $SPARK_HOME/lib/spark-examples.*jar has been moved to $SPARK_HOME/examples/jars and class JavaSparkSQL has been renamed JavaSparkSQLExample.

Issue Links

• links to: GitHub Pull Request #177