Query (id=294eccb4ce838db9:225a9f8b00000000) DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary Session ID: bf4e67550ba2018f:9507c568150725b9 Session Type: BEESWAX Start Time: 2017-04-11 07:11:37.341000000 End Time: 2017-04-11 07:11:56.863473000 Query Type: QUERY Query State: EXCEPTION Query Status: Sender timed out waiting for receiver fragment instance: 294eccb4ce838db9:225a9f8b00000004 Impala Version: impalad version 2.9.0-SNAPSHOT DEBUG (build 8146532b640eef012623a4ef107743f1bfc41cdd) User: jenkins Connected User: jenkins Delegated User: Network Address: 127.0.0.1:41357 Default Db: functional Sql Statement: select count(*) from tpch.lineitem inner join tpch.orders on l_orderkey = o_orderkey Coordinator: impala-boost-static-burst-slave-056a.vpc.cloudera.com:22000 Query Options (non default): ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0 Plan: ---------------- Estimated Per-Host Requirements: Memory=422.59MB VCores=2 PLAN-ROOT SINK | 06:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=3 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] | hosts=3 per-host-mem=unavailable | tuple-ids=2 row-size=8B cardinality=1 | 03:AGGREGATE | output: count(*) | hosts=3 per-host-mem=10.00MB | tuple-ids=2 row-size=8B cardinality=1 | 02:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: l_orderkey = o_orderkey | runtime filters: RF000 <- o_orderkey | hosts=3 per-host-mem=12.59MB | tuple-ids=0,1 row-size=16B cardinality=5757710 | |--04:EXCHANGE [BROADCAST] | | hosts=3 per-host-mem=0B | | tuple-ids=1 row-size=8B cardinality=1500000 | | | 01:SCAN HDFS [tpch.orders, RANDOM] | partitions=1/1 files=1 size=162.56MB | table stats: 1500000 rows total | column stats: all | hosts=3 per-host-mem=120.00MB | tuple-ids=1 row-size=8B cardinality=1500000 | 00:SCAN HDFS [tpch.lineitem, RANDOM] partitions=1/1 files=1 size=718.94MB runtime filters: RF000 -> l_orderkey table stats: 6001215 rows total column stats: all hosts=3 per-host-mem=400.00MB tuple-ids=0 row-size=8B cardinality=6001215 ---------------- Estimated Per-Host Mem: 443116161 Estimated Per-Host VCores: 2 Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------- 06:AGGREGATE 1 0.000ns 0.000ns 0 1 0 -1.00 B FINALIZE 05:EXCHANGE 1 0.000ns 0.000ns 0 1 0 -1.00 B UNPARTITIONED 03:AGGREGATE 3 0.000ns 0.000ns 0 1 0 10.00 MB 02:HASH JOIN 3 0.000ns 0.000ns 0 5.76M 0 12.59 MB INNER JOIN, BROADCAST |--04:EXCHANGE 3 0.000ns 0.000ns 0 1.50M 0 0 BROADCAST | 01:SCAN HDFS 3 0.000ns 0.000ns 0 1.50M 0 120.00 MB tpch.orders 00:SCAN HDFS 3 0.000ns 0.000ns 0 6.00M 0 400.00 MB tpch.lineitem Errors: (1 of 3 similar) - ComputeScanRangeAssignmentTimer: 0 - InactiveTotalTime: 0 - TotalTime: 0 Planner Timeline Metadata load started: 68627093 Metadata load finished: 5119244801 Metadata load started: 5123978915 Metadata load finished: 9139326167 Analysis finished: 9153244909 Equivalence classes computed: 9192959825 Single node plan created: 9241659122 Runtime filters computed: 9248586271 Distributed plan created: 9252518753 Planning finished: 9358503182 Query Timeline Query submitted: 0 Planning finished: 9385737600 Submit for admission: 9386737571 Completed admission: 9387737544 Ready to start 7 fragment instances: 9387737544 All 7 fragment instances started: 9392737406 Rows available: 19470455795 Unregister query: 19522454342 ImpalaServer - ClientFetchWaitTimer: 0 - InactiveTotalTime: 0 - RowMaterializationTimer: 0 - TotalTime: 0 Execution Profile 294eccb4ce838db9:225a9f8b00000000 Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 0 2 0 3 LOCAL false 0 (3) N/A N/A true Fragment instance start latencies: Count: 7, min / max: 2ms / 3ms, 25th %-ile: 2ms, 50th %-ile: 3ms, 75th %-ile: 3ms, 90th %-ile: 3ms, 95th %-ile: 3ms, 99.9th %-ile: 3ms Per Node Peak Memory Usage: impala-boost-static-burst-slave-056a.vpc.cloudera.com:22001(0) impala-boost-static-burst-slave-056a.vpc.cloudera.com:22002(0) impala-boost-static-burst-slave-056a.vpc.cloudera.com:22000(0) Final filter table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 0 2 0 3 LOCAL false 0 (3) N/A N/A true - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 10081718279 Coordinator Fragment F02 Instance 294eccb4ce838db9:225a9f8b00000000 (host=impala-boost-static-burst-slave-056a.vpc.cloudera.com:22000) Averaged Fragment F00 split sizes: min: 224.00 MB, max: 256.00 MB, avg: 239.65 MB, stddev: 13.07 MB completion times: min:10s076ms max:10s077ms mean: 10s077ms stddev:471.391us execution rates: min:22.23 MB/sec max:25.40 MB/sec mean:23.78 MB/sec stddev:1.30 MB/sec num instances: 3 Fragment F00 Instance 294eccb4ce838db9:225a9f8b00000004 (host=impala-boost-static-burst-slave-056a.vpc.cloudera.com:22002) Instance 294eccb4ce838db9:225a9f8b00000005 (host=impala-boost-static-burst-slave-056a.vpc.cloudera.com:22001) Instance 294eccb4ce838db9:225a9f8b00000006 (host=impala-boost-static-burst-slave-056a.vpc.cloudera.com:22000) Averaged Fragment F01 split sizes: min: 34.56 MB, max: 64.00 MB, avg: 54.19 MB, stddev: 13.88 MB completion times: min:10s076ms max:10s077ms mean: 10s077ms stddev:471.391us execution rates: min:3.43 MB/sec max:6.35 MB/sec mean:5.38 MB/sec stddev:1.38 MB/sec num instances: 3 Fragment F01 Instance 294eccb4ce838db9:225a9f8b00000001 (host=impala-boost-static-burst-slave-056a.vpc.cloudera.com:22002) Instance 294eccb4ce838db9:225a9f8b00000002 (host=impala-boost-static-burst-slave-056a.vpc.cloudera.com:22001) Instance 294eccb4ce838db9:225a9f8b00000003 (host=impala-boost-static-burst-slave-056a.vpc.cloudera.com:22000)