Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2939

Nested Types : Address Runtime & Scoped timer overhead

    XMLWordPrintableJSON

    Details

      Description

      For the following query about 45% of the time is spent in updating timers, RunTimeProfile and checking query state, since NestedTypes don't always operate on Batches the overhead of updating counters is amplified.

      select 
          l.l_shipdate, count(*) as wins
      from
          customer.c_orders o,
          o.o_lineitems l
      where
          o_orderdate = '1993-12-12'
      group by l.l_shipdate
      order by wins;
      
      Function Effective Time by Utilization
      clock_gettime 29.8% 0s 0s librt.so.1 clock_gettime
      impala::RuntimeProfile::Counter::Add 5.3%
      std::map<std::string, impala::RuntimeProfile::Counter*, std::less<std::string>, std::allocator<std::pair<std::string const, impala::RuntimeProfile::Counter*>>>::operator[] 4.7%
      impala::RuntimeState::CheckQueryState 3.2%
      impala::MonotonicStopWatch::Stop 2.7%

        Attachments

        1. Bottom-Up-HotFunctions.csv
          12 kB
          Mostafa Mokhtar
        2. nestedTypesQ1.zip
          4.02 MB
          Mostafa Mokhtar
        3. Top-Down-HotFunctions.csv
          49 kB
          Mostafa Mokhtar

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              mmokhtar Mostafa Mokhtar
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: