Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21787

Support for pushing down filters for DateType in native OrcFileFormat

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.2.0
    • 2.3.0
    • SQL
    • None

    Description

      See related issue https://issues.apache.org/jira/browse/SPARK-16516

      It seems that DateType should also be pushed down to ORC.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-20901 Feature parity for ORC with Parquet

          • Major - Major loss of function.
          • Open
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-20682 Add new ORCFileFormat based on Apache ORC

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #18995 [Github] Pull Request #18995 (dongjoon-hyun)

          Activity

            People

              dongjoon Dongjoon Hyun
              stefandekoning Stefan de Koning
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: