[IMPALA-4016] Avoid materializing slots only referenced by Kudu conjuncts

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Kudu_Impala
• Fix Version/s: Kudu_Impala, Impala 2.8.0
• Component/s: Frontend
• Labels: kudu
• Target Version: Kudu_Impala
• Assignee: Matthew Jacobs
• Reporter: Matthew Jacobs
• Created: 24/Aug/16 00:55
• Updated: 12/Sep/16 22:39
• Resolved: 08/Sep/16 14:32

Description

Right now, when SlotRefs are serialized to Thrift, Impala makes sure the slots are materialized. For Kudu we only need to mark them as materialized to build the kudu predicates, meaning the slots might not be referenced in the projection at all. In this case we should avoid materializing the slots (and thus allocating memory).

I believe that when we move to the scan token API we can avoid marking the SlotRefs as materialized.

Issue Links

• is blocked by: IMPALA-3481 Kudu Connector: use new Scan Token API