Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5210

Nested types : Scans spend 30% of CPU in impala::RuntimeProfile::Counter::Add and 8% in apic_timer_interrupt

    XMLWordPrintableJSON

Details

    • ghx-label-2

    Description

      Methods that call RuntimeProfile::Counter::Add

      Callers Effective Time by Utilization
      impala::RuntimeProfile::Counter::Add 100.00%
      impala::HdfsParquetScanner::AssembleCollection 99.20%
      impala::ScopedTimer<impala::MonotonicStopWatch>::UpdateCounter 0.40%
      impala::NestedLoopJoinNode::FindBuildMatches 0.30%
      [Unknown stack frame(s)] 0.10%
      impala::BlockingJoinNode::GetFirstProbeRow 0.00%
      impala::HdfsParquetScanner::AssembleRows 0.00%

      Methods called by RuntimeProfile::Counter::Add

      Callees Effective Time by Utilization Effective Time by Utilization
      impala::RuntimeProfile::Counter::Add 100.00% 0.00%
      impala::internal::AtomicInt<long>::Add 100.00% 0.00%
      Barrier_AtomicIncrement 100.00% 62.80%
      apic_timer_interrupt 29.30% 29.30%
      retint_careful 7.40% 7.40%
      common_interrupt 0.40% 0.10%
      paranoid_schedule 0.00% 0.00%
      __strncmp_sse42 0.00% 0.00%
      [Outside any known module] 0.00% 0.00%
      operator delete 0.00% 0.00%
      impala::ExprContext::GetBooleanVal 0.00% 0.00%

      Methods that call apic_timer_interrupt

      Callers Effective Time by Utilization Effective Time by Utilization
      apic_timer_interrupt 100.00% 99.70%
      impala::HdfsParquetScanner::AssembleCollection 32.10% 32.10%
      Barrier_AtomicIncrement 32.00% 31.90%
      impala::CollectionValueBuilder::GetFreeMemory 3.20% 3.20%
      impala::DictDecoder<impala::StringValue>::GetNextValue 3.00% 3.00%
      GetValue<int> 2.10% 2.10%
      impala::HdfsParquetScanner::ReadCollectionItem 1.90% 1.90%

      Query

      select count(*) from
        customer c,
        c.c_orders o,
        o.o_lineitems l
      where
        c_mktsegment = 'BUILDING'
        and o_orderdate < '1995-03-15'
        and l_shipdate > '1995-03-15' and o_orderkey = 10;
      

      Table

      +--------------+------------------------------------+---------+
      | name         | type                               | comment |
      +--------------+------------------------------------+---------+
      | c_custkey    | bigint                             |         |
      | c_name       | string                             |         |
      | c_address    | string                             |         |
      | c_nationkey  | bigint                             |         |
      | c_phone      | string                             |         |
      | c_acctbal    | decimal(12,2)                      |         |
      | c_mktsegment | string                             |         |
      | c_comment    | string                             |         |
      | c_orders     | array<struct<                      |         |
      |              |   o_orderkey:bigint,               |         |
      |              |   o_orderstatus:string,            |         |
      |              |   o_totalprice:decimal(12,2),      |         |
      |              |   o_orderdate:string,              |         |
      |              |   o_orderpriority:string,          |         |
      |              |   o_clerk:string,                  |         |
      |              |   o_shippriority:bigint,           |         |
      |              |   o_comment:string,                |         |
      |              |   o_lineitems:array<struct<        |         |
      |              |     l_partkey:bigint,              |         |
      |              |     l_suppkey:bigint,              |         |
      |              |     l_linenumber:bigint,           |         |
      |              |     l_quantity:decimal(12,2),      |         |
      |              |     l_extendedprice:decimal(12,2), |         |
      |              |     l_discount:decimal(12,2),      |         |
      |              |     l_tax:decimal(12,2),           |         |
      |              |     l_returnflag:string,           |         |
      |              |     l_linestatus:string,           |         |
      |              |     l_shipdate:string,             |         |
      |              |     l_commitdate:string,           |         |
      |              |     l_receiptdate:string,          |         |
      |              |     l_shipinstruct:string,         |         |
      |              |     l_shipmode:string,             |         |
      |              |     l_comment:string               |         |
      |              |   >>                               |         |
      |              | >>                                 |         |
      +--------------+------------------------------------+---------+
      

      Attachments

        1. tpch-q3-nested-simplified.txt
          200 kB
          Mostafa Mokhtar
        2. hotspots.csv
          1.05 MB
          Mostafa Mokhtar
        3. top-down.csv.zip
          1.02 MB
          Mostafa Mokhtar

        Activity

          People

            tianyiwang Tianyi Wang
            mmokhtar Mostafa Mokhtar
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: