Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-15799 Release SparkR on CRAN
  3. SPARK-20727

Skip SparkR tests when missing Hadoop winutils on CRAN windows machines

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.1.1, 2.2.0
    • 2.2.0, 2.3.0
    • SparkR
    • None

    Description

      We should skips tests that use the Hadoop libraries while running
      on CRAN check with Windows as the operating system. This is to handle
      cases where the Hadoop winutils binaries are not available on the target
      system. The skipped tests will consist of
      1. Tests that save, load a model in MLlib
      2. Tests that save, load CSV, JSON and Parquet files in SQL
      3. Hive tests

      Note that these tests will still be run on AppVeyor for every PR, so our overall test coverage should not go down

      Attachments

        Activity

          People

            shivaram Shivaram Venkataraman
            shivaram Shivaram Venkataraman
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: