[PHOENIX-4966] Implement unhandledFilters in PhoenixRelation so that spark only evaluates filters when required

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.14.0
• Fix Version/s: 4.15.0, 5.1.0
• Labels: phoenix-spark spark
• Assignee: Thomas D'Silva
• Reporter: Thomas D'Silva
• Created: 11/Oct/18 22:45
• Updated: 21/Dec/19 00:56
• Resolved: 12/Oct/18 21:07

Description

PhoenixRelation does not implement unhandledFilters so the data returned from a scan is run through filters twice.

Project [ID#7L]
+- Filter (((isnotnull(COL1#8) && isnotnull(ID#7L)) && (COL1#8 = test_row_1)) && (ID#7L = 1))
   +- Scan PhoenixRelation(TABLE1,localhost:50068:/hbase,false) [ID#7L,COL1#8] PushedFilters: [IsNotNull(COL1), IsNotNull(ID), EqualTo(COL1,test_row_1), EqualTo(ID,1)], ReadSchema: struct<ID:bigint>