Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-32244 Build and run the Spark with test cases in Github Actions
  3. SPARK-32491

Do not install SparkR in test-only mode in testing script

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.1.0
    • Project Infra
    • None

    Description

      Currently GitHub Actions builds are failed as below:

      ERROR: this R is version 3.4.4, package 'SparkR' requires R >= 3.5
      [error] running /home/runner/work/spark/spark/R/install-dev.sh ; received return code 1
      ##[error]Process completed with exit code 10.
      

      https://github.com/apache/spark/runs/926437963

      Looks GitHub Actions has R 3.4.4 installed by default; however, R 3.4 was dropped as of SPARK-32073. When SparkR tests are not needed, GitHub Actions does not install R 3.6 and it caused the test failure.

      In fact, SparkR is installed in case of running R linter, see SPARK-8505; however, we don't run the linters in test-only mode at testing script.

      We can safely skip it in test-only mode in our testing script.

      Attachments

        Activity

          People

            gurwls223 Hyukjin Kwon
            gurwls223 Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: