[IMPALA-11470] Support Caching Codegen Functions

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.3.0
• Component/s: Backend
• Epic Link: Codegen Caching for low latency queries
• Epic Color: ghx-label-11
• Assignee: Yida Wu
• Reporter: Yida Wu
• Created: 02/Aug/22 22:06
• Updated: 21/Aug/23 22:53
• Resolved: 07/Dec/22 22:05

Description

Impala traditionally has been a leader in low latency queries. However, it is reported that for sub second queries codegen could take the majority of the time, for example, codegen alone can take 300ms for a sub second query.

 

This task aims to add support of memory caches for codegen functions to improve the performance of sub second queries by reducing the codegen generation time. Users can specify the total cache size for all of the codegen functions and which query is going to use the cache.