Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-15799 Release SparkR on CRAN
  3. SPARK-20727

Skip SparkR tests when missing Hadoop winutils on CRAN windows machines

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.1.1, 2.2.0
    • Fix Version/s: 2.2.0, 2.3.0
    • Component/s: SparkR
    • Labels:
      None

      Description

      We should skips tests that use the Hadoop libraries while running
      on CRAN check with Windows as the operating system. This is to handle
      cases where the Hadoop winutils binaries are not available on the target
      system. The skipped tests will consist of
      1. Tests that save, load a model in MLlib
      2. Tests that save, load CSV, JSON and Parquet files in SQL
      3. Hive tests

      Note that these tests will still be run on AppVeyor for every PR, so our overall test coverage should not go down

        Attachments

          Activity

            People

            • Assignee:
              shivaram Shivaram Venkataraman
              Reporter:
              shivaram Shivaram Venkataraman
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: