[BIGTOP-3379] Fix Spark build failure on CentOS 8

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: spark
• Assignee: Kengo Seki
• Reporter: Kengo Seki
• Created: 23/Jul/20 23:13
• Updated: 27/Jul/20 23:22
• Resolved: 27/Jul/20 23:22

Description

Building Spark fails with the following error on CentOS 8, which provides R 4.0.2 as of now. Looks like the same issue as SPARK-31918.

--- re-building 'sparkr-vignettes.Rmd' using rmarkdown
Warning in engine$weave(file, quiet = quiet, encoding = enc) :
  Pandoc (>= 1.12.3) and/or pandoc-citeproc not available. Falling back to R Markdown v1.

Attaching package: 'SparkR'

The following objects are masked from 'package:stats':

    cov, filter, lag, na.omit, predict, sd, var, window

The following objects are masked from 'package:base':

    as.data.frame, colnames, colnames<-, drop, endsWith, intersect,
    rank, rbind, sample, startsWith, subset, summary, transform, union

(snip)

20/07/20 00:47:34 ERROR Executor: Exception in task 0.0 in stage 1.0 (TID 1)
org.apache.spark.SparkException: R computation failed with
 Error in lapply(part, FUN) : attempt to bind a variable to R_UnboundValue

(snip)

--- failed re-building 'sparkr-vignettes.Rmd'

SUMMARY: processing the following file failed:
  'sparkr-vignettes.Rmd'

Error: Vignette re-building failed.
Execution halted
error: Bad exit status from /var/tmp/rpm-tmp.fCRFJe (%build)
    Bad exit status from /var/tmp/rpm-tmp.fCRFJe (%build)


RPM build errors:

> Task :spark-rpm FAILED

Issue Links

• links to: https://github.com/apache/bigtop/pull/654