Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-16060

Vectorized ORC reader

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.6.3, 2.0.2, 2.1.2, 2.2.1
    • 2.3.0
    • SQL

    Description

      Currently Orc reader in Spark SQL doesn't support vectorized reading. As Hive Orc already support vectorization, we should add this support to improve Orc reading performance.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-20901 Feature parity for ORC with Parquet

          • Major - Major loss of function.
          • Open
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-18540 Wholestage code-gen for ORC Hive tables

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #13775 [Github] Pull Request #13775 (viirya)

          Pull request #19943 [Github] Pull Request #19943 (dongjoon-hyun)

          Pull request #20205 [Github] Pull Request #20205 (cloud-fan)

          Activity

            People

              dongjoon Dongjoon Hyun
              viirya L. C. Hsieh
              Votes:
              5 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: