Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-969

[C++] Evaluate SearchArguments using file and stripe level stats

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.8.0
    • 1.8.0
    • C++
    • None

    Description

      Currently in the C++ reader, SearchArguments are only evaluated on RowGroup level stats and bloom filters in SargsApplier::pickRowGroups():
      https://github.com/apache/orc/blob/2143841e24abb2e0fef1a3396376682fc3bb6fea/c%2B%2B/src/sargs/SargsApplier.cc#L65

      We can improve predicate push down to evaluate them on file and stripe level stats.

      Attachments

        Issue Links

        is duplicated by

        New Feature - A new feature of the product, which has yet to be developed. ORC-1135 [C++] ORC PPD use file stats and stripe stats

        • Major - Major loss of function.
        • Closed
        links to

        Web Link GitHub Pull Request #1073

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rex_xinzh ZhangXin
            stigahuang Quanlong Huang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment