[SPARK-24152] SparkR CRAN feasibility check server problem

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.4.5, 3.0.0
• Component/s: SparkR, Tests
• Assignee: L. C. Hsieh
• Reporter: Dongjoon Hyun
• Created: 02/May/18 17:14
• Updated: 12/Dec/22 18:11
• Resolved: 03/Nov/19 04:38

Description

PR builder and master branch test fails with the following SparkR error with unknown reason. The following is an error message from that.

* this is package 'SparkR' version '2.4.0'
* checking CRAN incoming feasibility ...Error in .check_package_CRAN_incoming(pkgdir) : 
  dims [product 24] do not match the length of object [0]
Execution halted

PR BUILDER

• https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90039/
• https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89983/
• https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89998/

MASTER BRANCH

• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-2.6/4458/ (Fail with no failures)

This is critical because we already start to merge the PR by ignoring this *known unkonwn* SparkR failure.

• https://github.com/apache/spark/pull/21175

Issue Links

• blocks: SPARK-24139 Fix Flaky Tests
• is related to: SPARK-25923 SparkR UT Failure (checking CRAN incoming feasibility)
• is related to: SPARK-29732 Add two Jenkins job to run `check-cran.sh` on branch-2.4/master
• relates to: SPARK-22812 Failing cran-check on master
• links to: GitHub Pull Request #26375
• links to: GitHub Pull Request #26381