Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4397

Codegen for compute stats query on 1K column table takes 4 minutes

    XMLWordPrintableJSON

Details

    Description

      Codegen of compute stats aggregation takes 4 minutes for a table with 1K columns

              CodeGen:(Total: 4m19s, non-child: 4m19s, % non-child: 100.00%)
                 - CodegenTime: 540.513ms
                 - CompileTime: 56s810ms
                 - LoadTime: 0.000ns
                 - ModuleBitcodeSize: 1.90 MB (1993816)
                 - NumFunctions: 14.03K (14033)
                 - NumInstructions: 265.60K (265603)
                 - OptimizationTime: 3m23s
                 - PrepareTime: 41.053ms
      

      Attachments

        1. VtuneTopDownTree.csv
          149 kB
          Mostafa Mokhtar
        2. Vtune-Bottom-Up.csv
          556 kB
          Mostafa Mokhtar
        3. CreateWideTable.sql
          350 kB
          Mostafa Mokhtar

        Issue Links

          Activity

            People

              tarmstrong Tim Armstrong
              mmokhtar Mostafa Mokhtar
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: