[FLINK-28691] Improve cache hit rate of generated class

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Table SQL / Runtime
• Assignee: Dan Zou
• Reporter: Dan Zou
• Created: 26/Jul/22 10:34
• Updated: 22/Dec/23 07:45

Description

In OLAP scenarios, compiling generated classes is very frequent, it will consume a lot of CPU and large amount of generated classes will also takes up a lot of space in metaspace, which will lead to frequent Full GC.

As we use a self-incrementing counter in CodeGenUtils#newName, it means we could not get the same generated class between two queries even when they are exactly the same. Maybe we could share the same generated class between different queries if they has the same logic, it will be good for job latency and resource consumption. 

Issue Links

• is blocked by: FLINK-33792 Generate the same code for the same logic