[SPARK-24535] Fix java version parsing in SparkR on Windows

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.3.1, 2.4.0
• Fix Version/s: 2.3.2, 2.4.0
• Component/s: SparkR
• Target Version/s: 2.3.2, 2.4.0
• Assignee: Felix Cheung
• Reporter: Shivaram Venkataraman
• Created: 12/Jun/18 22:14
• Updated: 12/Dec/22 18:11
• Resolved: 06/Jul/18 07:10

Description

We see errors on CRAN of the form 

  java version "1.8.0_144"
  Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
  Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)
  Picked up _JAVA_OPTIONS: -XX:-UsePerfData 
  -- 1. Error: create DataFrame from list or data.frame (@test_basic.R#21)  ------
  subscript out of bounds
  1: sparkR.session(master = sparkRTestMaster, enableHiveSupport = FALSE, sparkConfig = sparkRTestConfig) at D:/temp/RtmpIJ8Cc3/RLIBS_3242c713c3181/SparkR/tests/testthat/test_basic.R:21
  2: sparkR.sparkContext(master, appName, sparkHome, sparkConfigMap, sparkExecutorEnvMap, 
         sparkJars, sparkPackages)
  3: checkJavaVersion()
  4: strsplit(javaVersionFilter[[1]], "[\"]")

The complete log file is at http://home.apache.org/~shivaram/SparkR_2.3.1_check_results/Windows/00check.log

Issue Links

• links to: [Github] Pull Request #21666 (felixcheung)