[SPARK-17254] Filter operator should have “stop if false” semantics for sorted data

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Component/s: SQL
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Tejas Patil
• Created: 26/Aug/16 03:46
• Updated: 21/May/19 04:32
• Resolved: 21/May/19 04:32

Description

From https://issues.apache.org/jira/secure/attachment/12778890/BucketedTables.pdf:

Filter on sorted data

If the data is sorted by a key, filters on the key could stop as soon as the data is out of range. For example, WHERE ticker_id < “F” should stop as soon as the first row starting with “F” is seen. This can be done adding a Filter operator that has “stop if false” semantics. This is generally useful.

Issue Links

• links to: [Github] Pull Request #14847 (viirya)