[IMPALA-12091] Control scan fragment parallelism by its processing cost

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 4.2.0
• Fix Version/s: Impala 4.3.0
• Component/s: Frontend
• Epic Color: ghx-label-9
• Assignee: Riza Suminto
• Reporter: Riza Suminto
• Created: 24/Apr/23 17:51
• Updated: 24/Jun/23 04:43
• Resolved: 12/May/23 16:59

Description

Impala still rely on MT_DOP option to decide parallelism of scan fragment when query runs with COMPUTE_PROCESSING_COST=1. Planner should decide scan parallelism by its processing cost instead of fixed count dictated by MT_DOP.

Issue Links

• relates to: IMPALA-11437 Set different parallelism for scan and non-scan fragments