[BIGTOP-3451] Fix smoke test for SparkR

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: spark, tests
• Assignee: Kengo Seki
• Reporter: Kengo Seki
• Created: 16/Nov/20 17:52
• Updated: 19/Nov/20 02:48
• Resolved: 16/Nov/20 23:36

Description

Thanks to BIGTOP-3415, one of the Spark smoke test (testSparkSQL) got to succeed on Jenkins within five minutes. But the other one (testSparkSQL) continues to fail.
https://ci.bigtop.apache.org/view/Test/job/Bigtop-trunk-smoke-tests/COMPONENTS=hdfs.yarn.spark@spark,OS=centos-7-x86_64-deploy/ws/smoke-tests/spark/build/reports/tests/test/classes/org.apache.bigtop.itest.spark.TestSpark.html#tab1

I locally reproduced it and found the following error in the log. For avoiding this failure, the spark-sparkr package should depend on R so as to install it transitively.

Exception in thread "main" java.io.IOException: Cannot run program "Rscript": error=2, No such file or directory

Issue Links

• links to: https://github.com/apache/bigtop/pull/702