Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14917

Enable some ORC compressions tests for writing

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 2.0.0
    • 2.0.0
    • SQL
    • None

    Description

      Currently, it seems provided Hive version is 1.2.1. This supports SNAPPY and NONE according to those two links, https://orc.apache.org/docs/hive-config.html and https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC#LanguageManualORC-Compression

      However, I noticed the tests for SNAPPY and NONE were disabled. It seems this was disabled by SPARK-2883 due to the low Hive version but this was bumped up in SPARK-8064.

      It might be better if we enable this for better testing.

      Attachments

        Activity

          People

            gurwls223 Hyukjin Kwon
            gurwls223 Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: