Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-3379

Fix Spark build failure on CentOS 8

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: spark
    • Labels:
      None

      Description

      Building Spark fails with the following error on CentOS 8, which provides R 4.0.2 as of now. Looks like the same issue as SPARK-31918.

      --- re-building 'sparkr-vignettes.Rmd' using rmarkdown
      Warning in engine$weave(file, quiet = quiet, encoding = enc) :
        Pandoc (>= 1.12.3) and/or pandoc-citeproc not available. Falling back to R Markdown v1.
      
      Attaching package: 'SparkR'
      
      The following objects are masked from 'package:stats':
      
          cov, filter, lag, na.omit, predict, sd, var, window
      
      The following objects are masked from 'package:base':
      
          as.data.frame, colnames, colnames<-, drop, endsWith, intersect,
          rank, rbind, sample, startsWith, subset, summary, transform, union
      
      (snip)
      
      20/07/20 00:47:34 ERROR Executor: Exception in task 0.0 in stage 1.0 (TID 1)
      org.apache.spark.SparkException: R computation failed with
       Error in lapply(part, FUN) : attempt to bind a variable to R_UnboundValue
      
      (snip)
      
      --- failed re-building 'sparkr-vignettes.Rmd'
      
      SUMMARY: processing the following file failed:
        'sparkr-vignettes.Rmd'
      
      Error: Vignette re-building failed.
      Execution halted
      error: Bad exit status from /var/tmp/rpm-tmp.fCRFJe (%build)
          Bad exit status from /var/tmp/rpm-tmp.fCRFJe (%build)
      
      
      RPM build errors:
      
      > Task :spark-rpm FAILED
      

        Attachments

          Activity

            People

            • Assignee:
              sekikn Kengo Seki
              Reporter:
              sekikn Kengo Seki
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 50m
                50m