Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31744

Remove Hive dependency in AppVeyor build temporarily

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • SparkR, Tests
    • None

    Description

      Seems like we're skipping Hive related tests in SparkR (https://ci.appveyor.com/project/ApacheSoftwareFoundation/spark/builds/32853533), see below:

      test_sparkSQL.R:307: skip: create DataFrame from RDD
      Reason: Hive is not build with SparkSQL, skipped
      test_sparkSQL.R:1341: skip: test HiveContext
      Reason: Hive is not build with SparkSQL, skipped
      test_sparkSQL.R:2813: skip: read/write ORC files
      Reason: Hive is not build with SparkSQL, skipped
      test_sparkSQL.R:2834: skip: read/write ORC files - compression option
      Reason: Hive is not build with SparkSQL, skipped
      test_sparkSQL.R:3727: skip: enableHiveSupport on SparkSession
      Reason: Hive is not build with SparkSQL, skipped
      

      Although we build with Hive profile (https://github.com/apache/spark/blob/master/appveyor.yml#L51).

      It looks better to remove the profile for now which could also speed up the build

      Attachments

        Issue Links

          Activity

            People

              gurwls223 Hyukjin Kwon
              gurwls223 Hyukjin Kwon
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: