[BEAM-7655] Multiple Instances of Beam Table During Query Planning

• Type: Improvement
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Component/s: dsl-sql
• Assignee: Unassigned
• Reporter: Alireza Samadianzakaria
• Created: 28/Jun/19 23:21
• Updated: 04/Jun/22 13:32

Description

When Calcite is planning the query it may ask the table provider for the same table multiple times and in different alternative query plans there might be different instances of the same table.

Since the row count estimation is stored in the table instances, each time that the row count estimation is called for a new instance, the table creates a new estimate. The estimation may take some time; therefore, this can potentially downgrade the performance (of planning) and increase the planning time.

There are two potential ways to solve this problem:

1- Make sure that the table providers do not create multiple instances for the same table. 

or

2- Keep the row count estimations in a common data structure or a static Map and reuse it in multiple instances when needed.