[IMPALA-4397] Codegen for compute stats query on 1K column table takes 4 minutes

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.5.0
• Fix Version/s: Impala 2.8.0
• Component/s: Backend
• Labels: codegen scalability
• Target Version: Impala 2.8.0
• Assignee: Tim Armstrong
• Reporter: Mostafa Mokhtar
• Created: 29/Oct/16 17:26
• Updated: 09/May/17 20:16
• Resolved: 23/Nov/16 16:55

Description

Codegen of compute stats aggregation takes 4 minutes for a table with 1K columns

        CodeGen:(Total: 4m19s, non-child: 4m19s, % non-child: 100.00%)
           - CodegenTime: 540.513ms
           - CompileTime: 56s810ms
           - LoadTime: 0.000ns
           - ModuleBitcodeSize: 1.90 MB (1993816)
           - NumFunctions: 14.03K (14033)
           - NumInstructions: 265.60K (265603)
           - OptimizationTime: 3m23s
           - PrepareTime: 41.053ms

Issue Links

• is related to: IMPALA-5296 Codegen for aggregation with 1K grouping columns takes several seconds