Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-13233 [C++] Support ORC in Arrow Dataset
  3. ARROW-14890

[C++][Dataset] Add support for filter pushdown in the ORC Scanner

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • C++

    Description

      In arrow dataset, Filter pushdown can improve reading files performance greatly. We notice parquet has implemented, https://github.com/apache/arrow/blob/35b3567e73423420a99dbe6116f000e3c77d2a4c/cpp/src/arrow/dataset/file_parquet.cc#L465-L484.
      But ORC fileformat has not supported Filter pushdown. It ignores the "filter" of  ScanOptions now.

      Attachments

        Activity

          People

            Unassigned Unassigned
            zhixingheyi-tian zhixingheyi-tian
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated: