Query (id=554562a26c33f0c6:2ec25d2f00000000): Summary: Session ID: c14c74c52854535b:c65a80d19c921797 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2019-11-21 22:55:57.345543000 End Time: 2019-11-21 22:58:41.831588000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 3.4.0-SNAPSHOT RELEASE (build 8b8951378e200329841bd38b1ef7abbe4ed9be61) User: csso_drorke Connected User: csso_drorke Delegated User: Network Address: 127.0.0.1:44432 Default Db: tpcds_10000_decimal_parquet Sql Statement: -- start query 1 in stream 0 using template query13.tpl and seed 622697896 select avg(ss_quantity) ,avg(ss_ext_sales_price) ,avg(ss_ext_wholesale_cost) ,sum(ss_ext_wholesale_cost) from store_sales ,store ,customer_demographics ,household_demographics ,customer_address ,date_dim where s_store_sk = ss_store_sk and ss_sold_date_sk = d_date_sk and d_year = 2001 and((ss_hdemo_sk=hd_demo_sk and cd_demo_sk = ss_cdemo_sk and cd_marital_status = 'U' and cd_education_status = 'Secondary' and ss_sales_price between 100.00 and 150.00 and hd_dep_count = 3 )or (ss_hdemo_sk=hd_demo_sk and cd_demo_sk = ss_cdemo_sk and cd_marital_status = 'W' and cd_education_status = 'College' and ss_sales_price between 50.00 and 100.00 and hd_dep_count = 1 ) or (ss_hdemo_sk=hd_demo_sk and cd_demo_sk = ss_cdemo_sk and cd_marital_status = 'D' and cd_education_status = 'Primary' and ss_sales_price between 150.00 and 200.00 and hd_dep_count = 1 )) and((ss_addr_sk = ca_address_sk and ca_country = 'United States' and ca_state in ('TX', 'OK', 'MI') and ss_net_profit between 100 and 200 ) or (ss_addr_sk = ca_address_sk and ca_country = 'United States' and ca_state in ('WA', 'NC', 'OH') and ss_net_profit between 150 and 300 ) or (ss_addr_sk = ca_address_sk and ca_country = 'United States' and ca_state in ('MT', 'FL', 'GA') and ss_net_profit between 50 and 250 )) Coordinator: coordinator-0:22050 Query Options (set by configuration): TIMEZONE=UTC,CLIENT_IDENTIFIER=Impala Shell v3.3.0-SNAPSHOT (a509cff) built on Mon Jul 29 18:37:09 PDT 2019,NUM_REMOTE_EXECUTOR_CANDIDATES=2,DEFAULT_FILE_FORMAT=4,SPOOL_QUERY_RESULTS=1,DEFAULT_TRANSACTIONAL_TYPE=1 Query Options (set by configuration and planner): MT_DOP=0,TIMEZONE=UTC,CLIENT_IDENTIFIER=Impala Shell v3.3.0-SNAPSHOT (a509cff) built on Mon Jul 29 18:37:09 PDT 2019,NUM_REMOTE_EXECUTOR_CANDIDATES=2,DEFAULT_FILE_FORMAT=4,SPOOL_QUERY_RESULTS=1,DEFAULT_TRANSACTIONAL_TYPE=1 Plan: ---------------- Max Per-Host Resource Reservation: Memory=139.50MB Threads=13 Per-Host Resource Estimates: Memory=1.84GB Dedicated Coordinator Resource Estimate: Memory=126MB Analyzed query: SELECT avg(CAST(ss_quantity AS BIGINT)), avg(ss_ext_sales_price), avg(ss_ext_wholesale_cost), sum(ss_ext_wholesale_cost) FROM tpcds_10000_decimal_parquet.store_sales, tpcds_10000_decimal_parquet.store, tpcds_10000_decimal_parquet.customer_demographics, tpcds_10000_decimal_parquet.household_demographics, tpcds_10000_decimal_parquet.customer_address, tpcds_10000_decimal_parquet.date_dim WHERE s_store_sk = ss_store_sk AND ss_sold_date_sk = d_date_sk AND d_year = CAST(2001 AS INT) AND ss_hdemo_sk = hd_demo_sk AND cd_demo_sk = ss_cdemo_sk AND ((cd_marital_status = 'U' AND cd_education_status = 'Secondary' AND ss_sales_price >= CAST(100.00 AS DECIMAL(5,2)) AND ss_sales_price <= CAST(150.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(3 AS INT)) OR (cd_marital_status = 'W' AND cd_education_status = 'College' AND ss_sales_price >= CAST(50.00 AS DECIMAL(4,2)) AND ss_sales_price <= CAST(100.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(1 AS INT)) OR (cd_marital_status = 'D' AND cd_education_status = 'Primary' AND ss_sales_price >= CAST(150.00 AS DECIMAL(5,2)) AND ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(1 AS INT))) AND ss_addr_sk = ca_address_sk AND ca_country = 'United States' AND ((ca_state IN ('TX', 'OK', 'MI') AND ss_net_profit >= CAST(100 AS DECIMAL(3,0)) AND ss_net_profit <= CAST(200 AS DECIMAL(5,0))) OR (ca_state IN ('WA', 'NC', 'OH') AND ss_net_profit >= CAST(150 AS DECIMAL(5,0)) AND ss_net_profit <= CAST(300 AS DECIMAL(5,0))) OR (ca_state IN ('MT', 'FL', 'GA') AND ss_net_profit >= CAST(50 AS DECIMAL(3,0)) AND ss_net_profit <= CAST(250 AS DECIMAL(5,0)))) F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=14.00MB mem-reservation=4.00MB thread-reservation=1 PLAN-ROOT SINK | output exprs: avg(ss_quantity), avg(ss_ext_sales_price), avg(ss_ext_wholesale_cost), sum(ss_ext_wholesale_cost) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 | 18:AGGREGATE [FINALIZE] | output: avg:merge(ss_quantity), avg:merge(ss_ext_sales_price), avg:merge(ss_ext_wholesale_cost), sum:merge(ss_ext_wholesale_cost) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=7 row-size=40B cardinality=1 | in pipelines: 18(GETNEXT), 11(OPEN) | 17:EXCHANGE [UNPARTITIONED] | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | tuple-ids=6 row-size=40B cardinality=1 | in pipelines: 11(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 Per-Host Resources: mem-estimate=1.58GB mem-reservation=125.81MB thread-reservation=2 runtime-filters-memory=12.00MB 11:AGGREGATE | output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_ext_sales_price), avg(ss_ext_wholesale_cost), sum(ss_ext_wholesale_cost) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=6 row-size=40B cardinality=1 | in pipelines: 11(GETNEXT), 00(OPEN) | 10:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_hdemo_sk = hd_demo_sk | fk/pk conjuncts: ss_hdemo_sk = hd_demo_sk | other predicates: ((cd_marital_status = 'U' AND cd_education_status = 'Secondary' AND ss_sales_price >= CAST(100.00 AS DECIMAL(5,2)) AND ss_sales_price <= CAST(150.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(3 AS INT)) OR (cd_marital_status = 'W' AND cd_education_status = 'College' AND ss_sales_price >= CAST(50.00 AS DECIMAL(4,2)) AND ss_sales_price <= CAST(100.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(1 AS INT)) OR (cd_marital_status = 'D' AND cd_education_status = 'Primary' AND ss_sales_price >= CAST(150.00 AS DECIMAL(5,2)) AND ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(1 AS INT))) | runtime filters: RF000[bloom] <- hd_demo_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=0,5,4,2,1,3 row-size=181B cardinality=2.84G | in pipelines: 00(GETNEXT), 03(OPEN) | |--16:EXCHANGE [BROADCAST] | | mem-estimate=100.38KB mem-reservation=0B thread-reservation=0 | | tuple-ids=3 row-size=12B cardinality=7.20K | | in pipelines: 03(GETNEXT) | | | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=32.00MB mem-reservation=64.00KB thread-reservation=2 | 03:SCAN S3 [tpcds_10000_decimal_parquet.household_demographics, RANDOM] | S3 partitions=1/1 files=1 size=41.76KB | stored statistics: | table: rows=7.20K size=41.76KB | columns: all | extrapolated-rows=disabled max-scan-range-rows=7.20K | mem-estimate=32.00MB mem-reservation=64.00KB thread-reservation=1 | tuple-ids=3 row-size=12B cardinality=7.20K | in pipelines: 03(GETNEXT) | 09:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | fk/pk conjuncts: ss_store_sk = s_store_sk | runtime filters: RF002[bloom] <- s_store_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=0,5,4,2,1 row-size=169B cardinality=2.84G | in pipelines: 00(GETNEXT), 01(OPEN) | |--15:EXCHANGE [BROADCAST] | | mem-estimate=23.72KB mem-reservation=0B thread-reservation=0 | | tuple-ids=1 row-size=8B cardinality=1.50K | | in pipelines: 01(GETNEXT) | | | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=2 | 01:SCAN S3 [tpcds_10000_decimal_parquet.store, RANDOM] | S3 partitions=1/1 files=1 size=134.40KB | stored statistics: | table: rows=1.50K size=134.40KB | columns: all | extrapolated-rows=disabled max-scan-range-rows=1.50K | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=1 | tuple-ids=1 row-size=8B cardinality=1.50K | in pipelines: 01(GETNEXT) | 08:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_cdemo_sk = cd_demo_sk | fk/pk conjuncts: ss_cdemo_sk = cd_demo_sk | runtime filters: RF004[bloom] <- cd_demo_sk | mem-estimate=85.78MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=0,5,4,2 row-size=161B cardinality=2.84G | in pipelines: 00(GETNEXT), 02(OPEN) | |--14:EXCHANGE [BROADCAST] | | mem-estimate=10.45MB mem-reservation=0B thread-reservation=0 | | tuple-ids=2 row-size=43B cardinality=1.92M | | in pipelines: 02(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | Per-Host Resources: mem-estimate=48.00MB mem-reservation=512.00KB thread-reservation=2 | 02:SCAN S3 [tpcds_10000_decimal_parquet.customer_demographics, RANDOM] | S3 partitions=1/1 files=20 size=9.21MB | stored statistics: | table: rows=1.92M size=9.21MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=96.51K | mem-estimate=48.00MB mem-reservation=512.00KB thread-reservation=1 | tuple-ids=2 row-size=43B cardinality=1.92M | in pipelines: 02(GETNEXT) | 07:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_addr_sk = ca_address_sk | fk/pk conjuncts: ss_addr_sk = ca_address_sk | other predicates: ((ca_state IN ('TX', 'OK', 'MI') AND ss_net_profit >= CAST(100 AS DECIMAL(3,0)) AND ss_net_profit <= CAST(200 AS DECIMAL(5,0))) OR (ca_state IN ('WA', 'NC', 'OH') AND ss_net_profit >= CAST(150 AS DECIMAL(5,0)) AND ss_net_profit <= CAST(300 AS DECIMAL(5,0))) OR (ca_state IN ('MT', 'FL', 'GA') AND ss_net_profit >= CAST(50 AS DECIMAL(3,0)) AND ss_net_profit <= CAST(250 AS DECIMAL(5,0)))) | runtime filters: RF006[bloom] <- ca_address_sk | mem-estimate=793.54MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=0,5,4 row-size=119B cardinality=2.87G | in pipelines: 00(GETNEXT), 04(OPEN) | |--13:EXCHANGE [BROADCAST] | | mem-estimate=10.49MB mem-reservation=0B thread-reservation=0 | | tuple-ids=4 row-size=47B cardinality=16.25M | | in pipelines: 04(GETNEXT) | | | F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | Per-Host Resources: mem-estimate=120.00MB mem-reservation=8.00MB thread-reservation=2 | 04:SCAN S3 [tpcds_10000_decimal_parquet.customer_address, RANDOM] | S3 partitions=1/1 files=20 size=599.67MB | predicates: ca_country = 'United States' | stored statistics: | table: rows=32.50M size=599.67MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=1.63M | parquet statistics predicates: ca_country = 'United States' | parquet dictionary predicates: ca_country = 'United States' | mem-estimate=120.00MB mem-reservation=8.00MB thread-reservation=1 | tuple-ids=4 row-size=47B cardinality=16.25M | in pipelines: 04(GETNEXT) | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | fk/pk conjuncts: ss_sold_date_sk = d_date_sk | runtime filters: RF008[bloom] <- d_date_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=0,5 row-size=72B cardinality=5.75G | in pipelines: 00(GETNEXT), 05(OPEN) | |--12:EXCHANGE [BROADCAST] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | | tuple-ids=5 row-size=12B cardinality=373 | | in pipelines: 05(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=32.00MB mem-reservation=1.00MB thread-reservation=2 | 05:SCAN S3 [tpcds_10000_decimal_parquet.date_dim, RANDOM] | S3 partitions=1/1 files=1 size=2.15MB | predicates: d_year = CAST(2001 AS INT) | stored statistics: | table: rows=73.05K size=2.15MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K | parquet statistics predicates: d_year = CAST(2001 AS INT) | parquet dictionary predicates: d_year = CAST(2001 AS INT) | mem-estimate=32.00MB mem-reservation=1.00MB thread-reservation=1 | tuple-ids=5 row-size=12B cardinality=373 | in pipelines: 05(GETNEXT) | 00:SCAN S3 [tpcds_10000_decimal_parquet.store_sales, RANDOM] S3 partitions=1824/1824 files=5998 size=1.36TB runtime filters: RF000[bloom] -> ss_hdemo_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_cdemo_sk, RF006[bloom] -> ss_addr_sk, RF008[bloom] -> ss_sold_date_sk stored statistics: table: rows=28.80G size=1.36TB partitions: 1824/1824 rows=28.80G columns: all extrapolated-rows=disabled max-scan-range-rows=5.13M mem-estimate=704.00MB mem-reservation=40.00MB thread-reservation=1 tuple-ids=0 row-size=60B cardinality=28.80G in pipelines: 00(GETNEXT) ---------------- Estimated Per-Host Mem: 1975747665 Request Pool: root.default Per Host Min Memory Reservation: impala-executor-000-3:22000(134.31 MB) coordinator-0:22050(4.00 MB) impala-executor-000-6:22000(134.31 MB) impala-executor-000-7:22000(134.31 MB) impala-executor-000-1:22000(134.44 MB) impala-executor-000-2:22000(135.31 MB) impala-executor-000-5:22000(134.38 MB) impala-executor-000-8:22000(126.31 MB) impala-executor-000-0:22000(134.31 MB) impala-executor-000-9:22000(134.31 MB) impala-executor-000-4:22000(134.31 MB) Per Host Number of Fragment Instances: impala-executor-000-3:22000(3) coordinator-0:22050(1) impala-executor-000-6:22000(3) impala-executor-000-7:22000(3) impala-executor-000-1:22000(4) impala-executor-000-2:22000(4) impala-executor-000-5:22000(4) impala-executor-000-8:22000(2) impala-executor-000-0:22000(3) impala-executor-000-9:22000(3) impala-executor-000-4:22000(3) Admission result: Admitted immediately Cluster Memory Admitted: 20.12 GB Executor Group: root.default-group-000 ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail -------------------------------------------------------------------------------------------------------------------------------------------------------- F06:ROOT 1 0.000ns 0.000ns 4.01 MB 4.00 MB 18:AGGREGATE 1 0.000ns 0.000ns 1 1 16.00 KB 10.00 MB FINALIZE 17:EXCHANGE 1 0.000ns 0.000ns 10 1 88.00 KB 16.00 KB UNPARTITIONED F00:EXCHANGE SENDER 10 0.000ns 0.000ns 1.58 KB 0 11:AGGREGATE 10 34.400ms 120.000ms 10 1 56.00 KB 10.00 MB 10:HASH JOIN 10 622.000ms 716.005ms 86.54K 2.84B 2.02 MB 1.94 MB INNER JOIN, BROADCAST |--16:EXCHANGE 10 0.000ns 0.000ns 7.20K 7.20K 184.00 KB 100.38 KB BROADCAST | F05:EXCHANGE SENDER 1 0.000ns 0.000ns 98.44 KB 0 | 03:SCAN S3 1 4.000ms 4.000ms 7.20K 7.20K 294.74 KB 32.00 MB tpcds_10000_decimal_parquet.household_demographics 09:HASH JOIN 10 163.200ms 204.000ms 63.03M 2.84B 2.01 MB 1.94 MB INNER JOIN, BROADCAST |--15:EXCHANGE 10 0.000ns 0.000ns 1.50K 1.50K 40.00 KB 23.72 KB BROADCAST | F04:EXCHANGE SENDER 1 0.000ns 0.000ns 142.19 KB 0 | 01:SCAN S3 1 4.000ms 4.000ms 1.50K 1.50K 185.72 KB 16.00 MB tpcds_10000_decimal_parquet.store 08:HASH JOIN 10 9s119ms 9s347ms 63.23M 2.84B 74.16 MB 85.78 MB INNER JOIN, BROADCAST |--14:EXCHANGE 10 22.000ms 47.999ms 1.92M 1.92M 14.29 MB 10.45 MB BROADCAST | F03:EXCHANGE SENDER 10 42.000ms 64.000ms 38.75 KB 0 | 02:SCAN S3 10 5.600ms 11.999ms 1.92M 1.92M 6.22 MB 48.00 MB tpcds_10000_decimal_parquet.customer_demographics 07:HASH JOIN 10 2m14s 2m18s 63.62M 2.87B 158.05 MB 793.54 MB INNER JOIN, BROADCAST |--13:EXCHANGE 10 394.400ms 547.998ms 31.53M 16.25M 13.19 MB 10.49 MB BROADCAST | F02:EXCHANGE SENDER 9 721.778ms 1s003ms 38.75 KB 0 | 04:SCAN S3 9 34.666ms 59.999ms 31.53M 16.25M 35.70 MB 120.00 MB tpcds_10000_decimal_parquet.customer_address 06:HASH JOIN 10 10s693ms 11s215ms 5.47B 5.75B 2.09 MB 1.94 MB INNER JOIN, BROADCAST |--12:EXCHANGE 10 0.000ns 0.000ns 365 373 16.00 KB 16.00 KB BROADCAST | F01:EXCHANGE SENDER 1 0.000ns 0.000ns 98.44 KB 0 | 05:SCAN S3 1 4.000ms 4.000ms 365 373 1.63 MB 32.00 MB tpcds_10000_decimal_parquet.date_dim 00:SCAN S3 10 2s938ms 3s175ms 5.47B 28.80B 1.56 GB 704.00 MB tpcds_10000_decimal_parquet.store_sales Errors: Query Compilation: 80.530ms - Metadata of all 6 tables cached: 6.671ms (6.671ms) - Analysis finished: 7.911ms (1.239ms) - Authorization finished (ranger): 10.097ms (2.186ms) - Value transfer graph computed: 10.362ms (265.658us) - Single node plan created: 70.713ms (60.350ms) - Runtime filters computed: 70.938ms (225.477us) - Distributed plan created: 70.971ms (33.090us) - Lineage info computed: 71.092ms (121.071us) - Planning finished: 80.530ms (9.437ms) Query Timeline: 2m44s - Query submitted: 0.000ns (0.000ns) - Planning finished: 88.000ms (88.000ms) - Submit for admission: 96.000ms (8.000ms) - Completed admission: 108.000ms (12.000ms) - Ready to start on 11 backends: 112.000ms (4.000ms) - All 11 execution backends (33 fragment instances) started: 120.000ms (8.000ms) - Rows available: 2m44s (2m44s) - First row fetched: 2m44s (348.000ms) - Last row fetched: 2m44s (0.000ns) - Released admission control resources: 2m44s (0.000ns) - Unregister query: 2m44s (376.000ms) - AdmissionControlTimeSinceLastUpdate: 88.000ms - ComputeScanRangeAssignmentTimer: 8.000ms Frontend: - CatalogFetch.ColumnStats.Hits: 107 - CatalogFetch.ColumnStats.Requests: 107 - CatalogFetch.ColumnStats.Time: 0 - CatalogFetch.Config.Hits: 1 - CatalogFetch.Config.Requests: 1 - CatalogFetch.Config.Time: 0 - CatalogFetch.DatabaseList.Hits: 1 - CatalogFetch.DatabaseList.Requests: 1 - CatalogFetch.DatabaseList.Time: 0 - CatalogFetch.PartitionLists.Hits: 6 - CatalogFetch.PartitionLists.Requests: 6 - CatalogFetch.PartitionLists.Time: 0 - CatalogFetch.Partitions.Hits: 3658 - CatalogFetch.Partitions.Requests: 3658 - CatalogFetch.Partitions.Time: 4ms - CatalogFetch.TableNames.Hits: 1 - CatalogFetch.TableNames.Requests: 1 - CatalogFetch.TableNames.Time: 0 - CatalogFetch.Tables.Hits: 6 - CatalogFetch.Tables.Requests: 6 - CatalogFetch.Tables.Time: 0 ImpalaServer: - ClientFetchWaitTimer: 716.000ms - NumRowsFetched: 1 (1) - NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 124.00 /sec - RowMaterializationTimer: 8.000ms Execution Profile 554562a26c33f0c6:2ec25d2f00000000:(Total: 2m44s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 5 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 8 6 0 LOCAL true 0 (10) N/A N/A true 6 7 0 LOCAL false 0 (10) N/A N/A true 4 8 0 LOCAL false 0 (10) N/A N/A true 2 9 0 LOCAL false 0 (10) N/A N/A true 0 10 0 LOCAL false 0 (10) N/A N/A true Backend startup latencies: Count: 11, min / max: 3ms / 5ms, 25th %-ile: 3ms, 50th %-ile: 3ms, 75th %-ile: 4ms, 90th %-ile: 4ms, 95th %-ile: 4ms, 99.9th %-ile: 5ms Slowest backend to start up: impala-executor-000-0:22000 Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 8 6 0 LOCAL true 0 (10) N/A N/A true 6 7 0 LOCAL false 0 (10) N/A N/A true 4 8 0 LOCAL false 0 (10) N/A N/A true 2 9 0 LOCAL false 0 (10) N/A N/A true 0 10 0 LOCAL false 0 (10) N/A N/A true Per Node Peak Memory Usage: impala-executor-000-3:22000(1.66 GB) coordinator-0:22050(4.11 MB) impala-executor-000-6:22000(1.66 GB) impala-executor-000-7:22000(1.66 GB) impala-executor-000-1:22000(1.66 GB) impala-executor-000-2:22000(1.66 GB) impala-executor-000-5:22000(1.66 GB) impala-executor-000-8:22000(1.66 GB) impala-executor-000-0:22000(1.66 GB) impala-executor-000-9:22000(1.66 GB) impala-executor-000-4:22000(1.66 GB) Per Node Bytes Read: impala-executor-000-3:22000(10.44 GB) coordinator-0:22050(0) impala-executor-000-6:22000(10.31 GB) impala-executor-000-7:22000(10.34 GB) impala-executor-000-1:22000(10.32 GB) impala-executor-000-2:22000(10.33 GB) impala-executor-000-5:22000(10.42 GB) impala-executor-000-8:22000(10.37 GB) impala-executor-000-0:22000(10.37 GB) impala-executor-000-9:22000(10.34 GB) impala-executor-000-4:22000(10.32 GB) Per Node User Time: impala-executor-000-3:22000(2m52s) coordinator-0:22050(23.439ms) impala-executor-000-6:22000(2m56s) impala-executor-000-7:22000(2m52s) impala-executor-000-1:22000(2m56s) impala-executor-000-2:22000(2m53s) impala-executor-000-5:22000(2m55s) impala-executor-000-8:22000(2m50s) impala-executor-000-0:22000(2m55s) impala-executor-000-9:22000(2m53s) impala-executor-000-4:22000(2m48s) Per Node System Time: impala-executor-000-3:22000(31s404ms) coordinator-0:22050(0.000ns) impala-executor-000-6:22000(32s620ms) impala-executor-000-7:22000(32s306ms) impala-executor-000-1:22000(32s225ms) impala-executor-000-2:22000(32s534ms) impala-executor-000-5:22000(33s286ms) impala-executor-000-8:22000(31s042ms) impala-executor-000-0:22000(32s644ms) impala-executor-000-9:22000(33s239ms) impala-executor-000-4:22000(32s898ms) - ExchangeScanRatio: 0.07 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - InnerNodeSelectivityRatio: 0.00 - NumBackends: 11 (11) - NumCompletedBackends: 11 (11) - NumFragmentInstances: 33 (33) - NumFragments: 7 (7) - TotalBytesRead: 103.57 GB (111202586372) - TotalBytesSent: 7.77 GB (8340087710) - TotalCpuTime: 34m18s - TotalInnerBytesSent: 0 - TotalScanBytesSent: 7.77 GB (8340087710) Per Node Profiles: impala-executor-000-3:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 31.38 GB (33697038336) - ScratchBytesWritten: 39.81 GB (42750443520) - ScratchFileUsedBytes: 39.09 GB (41972400128) - ScratchReads: 16.07K (16068) - ScratchWrites: 20.39K (20385) - TotalEncryptionTime: 25s463ms - TotalReadBlockTime: 15s215ms coordinator-0:22050: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns impala-executor-000-6:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 30.95 GB (33229373440) - ScratchBytesWritten: 39.42 GB (42324721664) - ScratchFileUsedBytes: 38.66 GB (41508929536) - ScratchReads: 15.85K (15845) - ScratchWrites: 20.18K (20182) - TotalEncryptionTime: 25s819ms - TotalReadBlockTime: 15s675ms impala-executor-000-7:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 31.01 GB (33294385152) - ScratchBytesWritten: 39.42 GB (42328915968) - ScratchFileUsedBytes: 38.71 GB (41567649792) - ScratchReads: 15.88K (15876) - ScratchWrites: 20.18K (20184) - TotalEncryptionTime: 25s475ms - TotalReadBlockTime: 15s319ms impala-executor-000-1:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 31.01 GB (33292288000) - ScratchBytesWritten: 39.48 GB (42393927680) - ScratchFileUsedBytes: 38.72 GB (41571844096) - ScratchReads: 15.88K (15875) - ScratchWrites: 20.21K (20215) - TotalEncryptionTime: 24s499ms - TotalReadBlockTime: 15s111ms impala-executor-000-2:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 31.01 GB (33300676608) - ScratchBytesWritten: 39.40 GB (42310041600) - ScratchFileUsedBytes: 38.72 GB (41580232704) - ScratchReads: 15.88K (15879) - ScratchWrites: 20.18K (20175) - TotalEncryptionTime: 24s680ms - TotalReadBlockTime: 15s108ms impala-executor-000-5:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 31.38 GB (33692844032) - ScratchBytesWritten: 39.85 GB (42788192256) - ScratchFileUsedBytes: 39.08 GB (41966108672) - ScratchReads: 16.07K (16066) - ScratchWrites: 20.40K (20403) - TotalEncryptionTime: 24s636ms - TotalReadBlockTime: 15s632ms impala-executor-000-8:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 31.27 GB (33577500672) - ScratchBytesWritten: 39.74 GB (42670751744) - ScratchFileUsedBytes: 38.98 GB (41854959616) - ScratchReads: 16.01K (16011) - ScratchWrites: 20.35K (20347) - TotalEncryptionTime: 24s904ms - TotalReadBlockTime: 15s248ms impala-executor-000-0:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 31.15 GB (33449574400) - ScratchBytesWritten: 39.61 GB (42530242560) - ScratchFileUsedBytes: 38.86 GB (41724936192) - ScratchReads: 15.95K (15950) - ScratchWrites: 20.28K (20280) - TotalEncryptionTime: 25s067ms - TotalReadBlockTime: 15s451ms impala-executor-000-9:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 31.02 GB (33302773760) - ScratchBytesWritten: 39.31 GB (42213572608) - ScratchFileUsedBytes: 38.72 GB (41578135552) - ScratchReads: 15.88K (15880) - ScratchWrites: 20.13K (20129) - TotalEncryptionTime: 24s544ms - TotalReadBlockTime: 15s196ms impala-executor-000-4:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 30.97 GB (33256636416) - ScratchBytesWritten: 39.25 GB (42142269440) - ScratchFileUsedBytes: 38.68 GB (41536192512) - ScratchReads: 15.86K (15858) - ScratchWrites: 20.09K (20095) - TotalEncryptionTime: 24s148ms - TotalReadBlockTime: 14s964ms Averaged Fragment F06:(Total: 2m44s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:2m44s max:2m44s mean: 2m44s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 4.03 MB (4223192) - PeakReservation: 4.00 MB (4194304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 4.11 MB (4309208) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 2m43s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 2m44s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 23.439ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 348.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 2m44s - ExecTreeOpenTime: 2m43s - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns PLAN_ROOT_SINK:(Total: 348.000ms, non-child: 348.000ms, % non-child: 100.00%) - PeakMemoryUsage: 4.01 MB (4202496) - RowBatchGetWaitTime: 0.000ns - RowBatchSendWaitTime: 0.000ns - RowsSent: 1 (1) - RowsSentRate: 2.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 100.00 MB (104857600) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns AGGREGATION_NODE (id=18):(Total: 2m43s, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) EXCHANGE_NODE (id=17):(Total: 2m43s, non-child: 2m43s, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 88.00 KB (90112) - RowsReturned: 10 (10) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 160.00 KB (163840) - CumulativeAllocations: 20 (20) - PeakReservation: 88.00 KB (90112) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 88.00 KB (90112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 2m37s - TotalBytesDequeued: 890.00 B (890) - TotalGetBatchTime: 2m43s - DataWaitTime: 2m43s Enqueue: - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 10 (10) - TotalBatchesReceived: 10 (10) - TotalBytesReceived: 500.00 B (500) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 22.945ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 7 (7) - NumInstructions: 83 (83) - OptimizationTime: 8.000ms - PeakMemoryUsage: 41.50 KB (42496) - PrepareTime: 12.000ms Coordinator Fragment F06: Instance 554562a26c33f0c6:2ec25d2f00000000 (host=coordinator-0:22050):(Total: 2m44s, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:41.831 Fragment Instance Lifecycle Event Timeline: 2m44s - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 2m44s (2m44s) - First Batch Produced: 2m44s (0.000ns) - First Batch Sent: 2m44s (0.000ns) - ExecInternal Finished: 2m44s (348.000ms) - MemoryUsage (4s000ms): 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 32.21 KB, 93.21 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 4.03 MB (4223192) - PeakReservation: 4.00 MB (4194304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 4.11 MB (4309208) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 2m43s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 2m44s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 23.439ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 348.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 2m44s - ExecTreeOpenTime: 2m43s - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns PLAN_ROOT_SINK:(Total: 348.000ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 4.01 MB (4202496) - RowBatchGetWaitTime: 0.000ns - RowBatchSendWaitTime: 0.000ns - RowsSent: 1 (1) - RowsSentRate: 2.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 100.00 MB (104857600) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns AGGREGATION_NODE (id=18):(Total: 2m43s, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 2m44s - Open Started: 24.000ms (24.000ms) - Open Finished: 2m44s (2m43s) - First Batch Requested: 2m44s (0.000ns) - First Batch Returned: 2m44s (0.000ns) - Last Batch Returned: 2m44s (0.000ns) - Closed: 2m44s (348.000ms) - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) EXCHANGE_NODE (id=17):(Total: 2m43s, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 2m44s - Open Started: 24.000ms (24.000ms) - Open Finished: 2m37s (2m37s) - First Batch Requested: 2m37s (0.000ns) - First Batch Returned: 2m44s (6s160ms) - Last Batch Returned: 2m44s (0.000ns) - Closed: 2m44s (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 88.00 KB (90112) - RowsReturned: 10 (10) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 160.00 KB (163840) - CumulativeAllocations: 20 (20) - PeakReservation: 88.00 KB (90112) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 88.00 KB (90112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 111.00 B, 678.00 B - FirstBatchWaitTime: 2m37s - TotalBytesDequeued: 890.00 B (890) - TotalGetBatchTime: 2m43s - DataWaitTime: 2m43s Enqueue: - BytesReceived (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 62.00 B, 381.00 B - DeferredQueueSize (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 34.914us ; Min: 28.989us ; Max: 41.194us ; Number of samples: 10) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 10 (10) - TotalBatchesReceived: 10 (10) - TotalBytesReceived: 500.00 B (500) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 22.945ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 7 (7) - NumInstructions: 83 (83) - OptimizationTime: 8.000ms - PeakMemoryUsage: 41.50 KB (42496) - PrepareTime: 12.000ms Averaged Fragment F00:(Total: 2m40s, non-child: 1.200ms, % non-child: 0.00%) split sizes: min: 138.82 GB, max: 139.24 GB, avg: 139.03 GB, stddev: 120.59 MB completion times: min:2m37s max:2m44s mean: 2m40s stddev:1s778ms execution rates: min:868.95 MB/sec max:901.86 MB/sec mean:887.41 MB/sec stddev:9.69 MB/sec num instances: 10 - AverageThreadTokens: 8.62 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.64 GB (1764142401) - PeakReservation: 1.60 GB (1714854297) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785310845) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1s155ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 8s551ms - TotalThreadsInvoluntaryContextSwitches: 1.01K (1008) - TotalThreadsTotalWallClockTime: 23m3s - TotalThreadsSysTime: 32s242ms - TotalThreadsUserTime: 2m52s - TotalThreadsVoluntaryContextSwitches: 577.27K (577268) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m40s - ExecTreeOpenTime: 2m39s - PrepareTime: 3.200ms - ExecTreePrepareTime: 2.000ms KrpcDataStreamSender (dst_id=17): - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 50.00 B (50) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m39s, non-child: 33.600ms, % non-child: 0.02%) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: - BuildTime: 1.200ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m39s, non-child: 622.000ms, % non-child: 0.39%) - BuildRows: 7.20K (7200) - BuildTime: 6.800ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.30M (6303343) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 614.800ms - RowsReturned: 8.65K (8653) - RowsReturnedRate: 53.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): - BuildRowsPartitionTime: 800.000us - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 399.998us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.30M (6300820) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m38s, non-child: 163.200ms, % non-child: 0.10%) - BuildRows: 1.50K (1500) - BuildTime: 6.400ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.32M (6323006) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 130.400ms - RowsReturned: 6.30M (6303343) - RowsReturnedRate: 39.68 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.30M (6304843) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m38s, non-child: 9s119ms, % non-child: 5.75%) - BuildRows: 1.92M (1920800) - BuildTime: 366.400ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 52.57 MB (55125248) - ProbeRows: 6.36M (6361724) - ProbeRowsPartitioned: 5.85M (5851065) - ProbeTime: 1s660ms - RowsReturned: 6.32M (6323006) - RowsReturnedRate: 39.85 K/sec Buffer pool: - AllocTime: 22.000ms - CumulativeAllocationBytes: 944.20 MB (990065459) - CumulativeAllocations: 455 (455) - PeakReservation: 44.40 MB (46556774) - PeakUnpinnedBytes: 791.00 MB (829423616) - PeakUsedReservation: 44.20 MB (46347059) - ReadIoBytes: 80.80 MB (84724940) - ReadIoOps: 40 (40) - ReadIoWaitTime: 25.600ms - SystemAllocTime: 20.800ms - WriteIoBytes: 791.00 MB (829423616) - WriteIoOps: 395 (395) - WriteIoWaitTime: 100.799ms Hash Join Builder (join_node_id=8): - BuildRowsPartitionTime: 317.200ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 83.600ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 14 (14) Hash Table: - HashBuckets: 4.27M (4272947) - HashCollisions: 0 (0) - Probes: 8.24M (8243806) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 115.200ms, non-child: 115.200ms, % non-child: 100.00%) - ConvertRowBatchTime: 18.800ms - PeakMemoryUsage: 14.28 MB (14976225) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 18.35 M/sec Buffer pool: - AllocTime: 45.200ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.08 MB (14761164) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.08 MB (14761164) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 43.200ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 95.200ms - DataWaitTime: 93.200ms Enqueue: - DeserializeRowBatchTime: 146.000ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 947.264ms - TotalRPCsDeferred: 144 (144) HASH_JOIN_NODE (id=7):(Total: 2m29s, non-child: 2m14s, % non-child: 89.99%) - BuildRows: 31.53M (31525830) - BuildTime: 5s718ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 546.92M (546919311) - ProbeRowsPartitioned: 534.07M (534071813) - ProbeTime: 1m47s - RowsReturned: 6.36M (6361724) - RowsReturnedRate: 42.54 K/sec Buffer pool: - AllocTime: 4s358ms - CumulativeAllocationBytes: 70.79 GB (76014210252) - CumulativeAllocations: 35.75K (35750) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 38.76 GB (41615884288) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 31.04 GB (33324584140) - ReadIoOps: 15.89K (15890) - ReadIoWaitTime: 15s291ms - SystemAllocTime: 4s334ms - WriteIoBytes: 38.76 GB (41615884288) - WriteIoOps: 19.84K (19844) - WriteIoWaitTime: 29s028ms Hash Join Builder (join_node_id=7): - BuildRowsPartitionTime: 5s667ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 1s935ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 565.60M (565597643) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 1s388ms, non-child: 1s388ms, % non-child: 100.00%) - ConvertRowBatchTime: 320.800ms - PeakMemoryUsage: 13.15 MB (13788230) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 25.65 M/sec Buffer pool: - AllocTime: 84.400ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 12.96 MB (13587251) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.96 MB (13587251) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 58.800ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 1s054ms - DataWaitTime: 994.001ms Enqueue: - DeserializeRowBatchTime: 1s481ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 1s663ms - TotalRPCsDeferred: 3.10K (3101) HASH_JOIN_NODE (id=6):(Total: 13s631ms, non-child: 10s693ms, % non-child: 78.44%) - BuildRows: 365 (365) - BuildTime: 6.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 546.92M (546919311) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s465ms - RowsReturned: 546.92M (546919311) - RowsReturnedRate: 40.16 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 546.92M (546919676) - Resizes: 0 (0) - Travel: 182.75M (182752048) EXCHANGE_NODE (id=12): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s938ms, non-child: 2s938ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.57 - AverageScannerThreadConcurrency: 12.88 - BytesRead: 10.34 GB (11102938820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 1.97K (1973) - CachedFileHandlesMissCount: 5 (5) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 9.97 GB (10700023783) - DataCacheHitCount: 1.91K (1905) - DataCacheMissBytes: 384.25 MB (402915037) - DataCacheMissCount: 73 (73) - DataCachePartialHitCount: 29 (29) - DecompressionTime: 8s747ms - MaterializeTupleTime(*): 1m2s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 263.59K (263590) - NumRowGroups: 115 (115) - NumRowGroupsWithPageIndex: 115 (115) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 GB (1649754928) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 209.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.59 GB (33918201036) - RowBatchQueueGetWaitTime: 128.800ms - RowBatchQueuePeakMemoryUsage: 6.46 MB (6770278) - RowBatchQueuePutWaitTime: 18m49s - RowBatchesEnqueued: 534.35K (534354) - RowsRead: 547.00M (547000765) - RowsReturned: 546.92M (546919311) - RowsReturnedRate: 186.42 M/sec - ScanRangesComplete: 599 (599) - ScannerIoWaitTime: 8s551ms - ScannerThreadWorklessLoops: 25 (25) - ScannerThreadsInvoluntaryContextSwitches: 646 (646) - ScannerThreadsTotalWallClockTime: 20m14s - ScannerThreadsSysTime: 14s968ms - ScannerThreadsUserTime: 1m4s - ScannerThreadsVoluntaryContextSwitches: 543.57K (543572) - TotalRawHdfsOpenFileTime(*): 266.000ms - TotalRawHdfsReadTime(*): 54s379ms - TotalReadThroughput: 111.40 MB/sec Buffer pool: - AllocTime: 1s020ms - CumulativeAllocationBytes: 11.12 GB (11934944460) - CumulativeAllocations: 1.76K (1765) - PeakReservation: 1.50 GB (1610612736) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.30 GB (1397950054) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1s019ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1973330) - Rows rejected: 46.39K (46387) - Rows total: 547.00M (547000765) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1926943) - Rows rejected: 23.32K (23320) - Rows total: 546.95M (546954378) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.86M (1859778) - Rows rejected: 11.75K (11746) - Rows total: 546.93M (546931057) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.84M (1843834) - Rows rejected: 0 (0) - Rows total: 546.92M (546919311) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 599 (599) - Files rejected: 484 (484) - Files total: 599 (599) - RowGroups processed: 534.12K (534122) - RowGroups rejected: 0 (0) - RowGroups total: 534.12K (534122) - Rows processed: 1.89M (1892371) - Rows rejected: 0 (0) - Rows total: 546.92M (546919311) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) CodeGen:(Total: 931.202ms, non-child: 931.202ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 3 (3) - CodegenTotalWallClockTime: 931.202ms - CodegenSysTime: 3.584ms - CodegenUserTime: 927.386ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 284.000ms - IrGenerationTime: 30.400ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 602.801ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 12.000ms Fragment F00: Instance 554562a26c33f0c6:2ec25d2f0000001c (host=impala-executor-000-5:22000):(Total: 2m44s, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:41.479 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/139.18 GB Filter 0 arrival: 933ms Filter 2 arrival: 933ms Filter 8 arrival: 933ms Filter 4 arrival: 1s368ms Filter 6 arrival: 8s019ms Fragment Instance Lifecycle Event Timeline: 2m44s - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 2m44s (2m44s) - First Batch Produced: 2m44s (0.000ns) - First Batch Sent: 2m44s (0.000ns) - ExecInternal Finished: 2m44s (0.000ns) - MemoryUsage (4s000ms): 1.23 GB, 1.62 GB, 1.62 GB, 1.62 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.54 GB, 1.38 GB, 1.31 GB, 322.90 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.20 MB - ThreadUsage (4s000ms): 11, 15, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 12, 11, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 8.47 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.64 GB (1760822200) - PeakReservation: 1.60 GB (1713176576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1787087088) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1s284ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 5s360ms - TotalThreadsInvoluntaryContextSwitches: 1.06K (1062) - TotalThreadsTotalWallClockTime: 23m10s - TotalThreadsSysTime: 33s089ms - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 579.69K (579694) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m44s - ExecTreeOpenTime: 2m43s - PrepareTime: 4.000ms - ExecTreePrepareTime: 4.000ms KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 136.95 KB/sec ; Min: 136.95 KB/sec ; Max: 136.95 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 233.745us ; Min: 110.962us ; Max: 356.529us ; Number of samples: 2) - RpcRecvrTime: (Avg: 38.823us ; Min: 21.950us ; Max: 55.696us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 50.00 B (50) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m43s, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 2m44s - Open Started: 924.019ms (924.019ms) - Open Finished: 2m44s (2m43s) - First Batch Requested: 2m44s (0.000ns) - First Batch Returned: 2m44s (0.000ns) - Last Batch Returned: 2m44s (0.000ns) - Closed: 2m44s (0.000ns) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m43s, non-child: 555.999ms, % non-child: 0.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m44s - Open Started: 924.019ms (924.019ms) - Open Finished: 2m42s (2m41s) - First Batch Requested: 2m42s (0.000ns) - First Batch Returned: 2m42s (3.999ms) - Last Batch Returned: 2m44s (1s315ms) - Closed: 2m44s (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.34M (6343241) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 547.999ms - RowsReturned: 8.53K (8525) - RowsReturnedRate: 52.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.34M (6339860) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 932.019ms - Open Started: 924.019ms (924.019ms) - Open Finished: 924.019ms (0.000ns) - First Batch Requested: 928.019ms (4.000ms) - First Batch Returned: 928.019ms (0.000ns) - Last Batch Returned: 928.019ms (0.000ns) - Closed: 932.019ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 25.774us ; Min: 16.939us ; Max: 43.198us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m42s, non-child: 128.000ms, % non-child: 0.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m44s - Open Started: 924.019ms (924.019ms) - Open Finished: 2m42s (2m41s) - First Batch Requested: 2m42s (0.000ns) - First Batch Returned: 2m42s (0.000ns) - Last Batch Returned: 2m44s (1s319ms) - Closed: 2m44s (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.36M (6361712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 103.999ms - RowsReturned: 6.34M (6343241) - RowsReturnedRate: 39.03 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.34M (6344741) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 932.019ms - Open Started: 924.019ms (924.019ms) - Open Finished: 924.019ms (0.000ns) - First Batch Requested: 928.019ms (4.000ms) - First Batch Returned: 928.019ms (0.000ns) - Last Batch Returned: 928.019ms (0.000ns) - Closed: 932.019ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 36.392us ; Min: 25.443us ; Max: 47.341us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m42s, non-child: 9s068ms, % non-child: 5.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m44s - Open Started: 924.019ms (924.019ms) - Open Finished: 1m37s (1m36s) - First Batch Requested: 1m37s (0.000ns) - First Batch Returned: 1m37s (0.000ns) - Last Batch Returned: 2m44s (1m6s) - Closed: 2m44s (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 376.007ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 44.11 MB (46252288) - ProbeRows: 6.40M (6400587) - ProbeRowsPartitioned: 6.36M (6361712) - ProbeTime: 1s512ms - RowsReturned: 6.36M (6361712) - RowsReturnedRate: 39.17 K/sec Buffer pool: - AllocTime: 28.000ms - CumulativeAllocationBytes: 1020.00 MB (1069547520) - CumulativeAllocations: 494 (494) - PeakReservation: 36.00 MB (37748736) - PeakUnpinnedBytes: 862.00 MB (903872512) - PeakUsedReservation: 36.00 MB (37748736) - ReadIoBytes: 94.00 MB (98566144) - ReadIoOps: 47 (47) - ReadIoWaitTime: 39.999ms - SystemAllocTime: 28.000ms - WriteIoBytes: 862.00 MB (903872512) - WriteIoOps: 431 (431) - WriteIoWaitTime: 44.000ms Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 332.006ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 79.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.28M (8282512) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 104.002ms, non-child: 12.000ms, % non-child: 11.54%) Node Lifecycle Event Timeline: 1s408ms - Open Started: 924.019ms (924.019ms) - Open Finished: 924.019ms (0.000ns) - First Batch Requested: 928.019ms (4.000ms) - First Batch Returned: 928.019ms (0.000ns) - Last Batch Returned: 1s368ms (440.009ms) - Closed: 1s408ms (40.000ms) - ConvertRowBatchTime: 8.000ms - PeakMemoryUsage: 14.29 MB (14980369) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 18.47 M/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 90.48 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 96.002ms - DataWaitTime: 92.001ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 4.79 MB, 41.40 MB - DeferredQueueSize (500.000ms): 10, 10, 0 - DispatchTime: (Avg: 27.209us ; Min: 5.020us ; Max: 1.265ms ; Number of samples: 1881) - DeserializeRowBatchTime: 140.002ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 926.582ms - TotalRPCsDeferred: 46 (46) HASH_JOIN_NODE (id=7):(Total: 2m33s, non-child: 2m18s, % non-child: 90.23%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m44s - Open Started: 924.019ms (924.019ms) - Open Finished: 8s060ms (7s136ms) - First Batch Requested: 8s060ms (0.000ns) - First Batch Returned: 8s092ms (32.000ms) - Last Batch Returned: 2m42s (2m34s) - Closed: 2m44s (1s331ms) - BuildRows: 31.53M (31525830) - BuildTime: 5s560ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 550.59M (550586266) - ProbeRowsPartitioned: 537.63M (537631704) - ProbeTime: 1m50s - RowsReturned: 6.40M (6400587) - RowsReturnedRate: 41.74 K/sec Buffer pool: - AllocTime: 4s736ms - CumulativeAllocationBytes: 71.29 GB (76552339456) - CumulativeAllocations: 36.01K (36007) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 39.01 GB (41884319744) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 31.29 GB (33594277888) - ReadIoOps: 16.02K (16019) - ReadIoWaitTime: 15s612ms - SystemAllocTime: 4s712ms - WriteIoBytes: 39.01 GB (41884319744) - WriteIoOps: 19.97K (19972) - WriteIoWaitTime: 30s544ms Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5s512ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 1s896ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 569.16M (569157534) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 1s552ms, non-child: 400.004ms, % non-child: 25.77%) Node Lifecycle Event Timeline: 8s060ms - Open Started: 924.019ms (924.019ms) - Open Finished: 924.019ms (0.000ns) - First Batch Requested: 932.019ms (8.000ms) - First Batch Returned: 932.019ms (0.000ns) - Last Batch Returned: 8s020ms (7s088ms) - Closed: 8s060ms (40.000ms) - ConvertRowBatchTime: 360.004ms - PeakMemoryUsage: 13.15 MB (13789153) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 20.31 M/sec Buffer pool: - AllocTime: 52.000ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 28.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 74.77 MB, 186.76 MB, 304.71 MB, 424.69 MB, 548.05 MB, 671.90 MB, 794.39 MB, 920.81 MB, 1.02 GB, 1.14 GB, 1.26 GB, 1.38 GB, 1.50 GB, 1.60 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 1s188ms - DataWaitTime: 1s152ms Enqueue: - BytesReceived (500.000ms): 4.67 MB, 4.67 MB, 37.96 MB, 84.84 MB, 138.14 MB, 189.84 MB, 244.99 MB, 301.45 MB, 355.29 MB, 411.60 MB, 467.86 MB, 522.09 MB, 576.57 MB, 632.97 MB, 688.54 MB, 737.35 MB - DeferredQueueSize (500.000ms): 9, 9, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 17.727us ; Min: 4.796us ; Max: 4.239ms ; Number of samples: 30799) - DeserializeRowBatchTime: 1s452ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 910.026ms - TotalRPCsDeferred: 37 (37) HASH_JOIN_NODE (id=6):(Total: 13s484ms, non-child: 10s448ms, % non-child: 77.48%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m44s - Open Started: 924.019ms (924.019ms) - Open Finished: 1s096ms (172.003ms) - First Batch Requested: 8s060ms (6s964ms) - First Batch Returned: 8s060ms (0.000ns) - Last Batch Returned: 1m37s (1m29s) - Closed: 2m44s (1m6s) - BuildRows: 365 (365) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 550.59M (550586266) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s236ms - RowsReturned: 550.59M (550586266) - RowsReturnedRate: 40.83 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 550.59M (550586631) - Resizes: 0 (0) - Travel: 184.99M (184989844) EXCHANGE_NODE (id=12): Node Lifecycle Event Timeline: 932.019ms - Open Started: 924.019ms (924.019ms) - Open Finished: 924.019ms (0.000ns) - First Batch Requested: 932.019ms (8.000ms) - First Batch Returned: 932.019ms (0.000ns) - Last Batch Returned: 932.019ms (0.000ns) - Closed: 932.019ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 30.148us ; Min: 30.148us ; Max: 30.148us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s036ms, non-child: 3s036ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/139.18 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Not all filters arrived (arrived: [0, 2, 8], missing [4, 6]), waited for 67ms. Arrival delay: 1s000ms. Hdfs Read Thread Concurrency Bucket: 0:76.68% 1:7.772% 2:4.663% 3:4.145% 4:1.036% 5:3.109% 6:0% 7:1.036% 8:1.554% File Formats: PARQUET/SNAPPY:116 PARQUET/Unknown(Skipped):482 Node Lifecycle Event Timeline: 2m44s - Open Started: 924.019ms (924.019ms) - Open Finished: 928.019ms (4.000ms) - First Batch Requested: 932.019ms (4.000ms) - First Batch Returned: 1s096ms (164.003ms) - Last Batch Returned: 1m37s (1m36s) - Closed: 2m44s (1m6s) - BytesRead (2s000ms): 560.12 MB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.17 GB, 1.19 GB, 1.39 GB, 1.79 GB, 2.34 GB, 2.37 GB, 2.44 GB, 3.02 GB, 3.54 GB, 3.58 GB, 3.91 GB, 4.70 GB, 4.81 GB, 5.05 GB, 5.67 GB, 5.92 GB, 6.30 GB, 6.79 GB, 7.09 GB, 7.40 GB, 7.96 GB, 8.26 GB, 8.32 GB, 8.47 GB, 8.60 GB, 8.90 GB, 9.04 GB, 9.13 GB, 9.15 GB, 9.28 GB, 9.38 GB, 9.44 GB, 9.54 GB, 9.88 GB, 9.90 GB, 9.99 GB, 10.35 GB, 10.39 GB, 10.39 GB, 10.40 GB, 10.41 GB, 10.41 GB - FooterProcessingTime: (Avg: 413.799us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 116) - InitialRangeActualReservation: (Avg: 109.38 MB (114692519) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 116) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 116) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.14 GB (1226484005) ; Min: 476.44 MB (499588180) ; Max: 2.02 GB (2170960123) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.62 KB (41598) ; Min: 12.00 B (12) ; Max: 71.37 KB (73084) ; Number of samples: 265357) - ParquetRowGroupActualReservation: (Avg: 118.21 MB (123948914) ; Min: 64.00 MB (67108864) ; Max: 136.00 MB (142606336) ; Number of samples: 116) - ParquetRowGroupIdealReservation: (Avg: 119.28 MB (125069806) ; Min: 88.00 MB (92274688) ; Max: 136.00 MB (142606336) ; Number of samples: 116) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.82 GB (1950151983) ; Min: 489.52 MB (513303144) ; Max: 3.70 GB (3977888182) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.59 KB (66142) ; Min: 10.00 B (10) ; Max: 72.39 KB (74131) ; Number of samples: 265357) - AverageHdfsReadThreadConcurrency: 0.72 - AverageScannerThreadConcurrency: 12.61 - BytesRead: 10.41 GB (11173593845) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 1.88K (1881) - CachedFileHandlesMissCount: 4 (4) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 9.95 GB (10682562902) - DataCacheHitCount: 1.82K (1816) - DataCacheMissBytes: 468.28 MB (491030943) - DataCacheMissCount: 69 (69) - DataCachePartialHitCount: 14 (14) - DecompressionTime: 8s576ms - MaterializeTupleTime(*): 1m2s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 265.36K (265357) - NumRowGroups: 116 (116) - NumRowGroupsWithPageIndex: 116 (116) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 GB (1657878252) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 166.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.80 GB (34145654784) - RowBatchQueueGetWaitTime: 96.002ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 18m56s - RowBatchesEnqueued: 537.94K (537937) - RowsRead: 550.67M (550668182) - RowsReturned: 550.59M (550586266) - RowsReturnedRate: 181.35 M/sec - ScanRangesComplete: 598 (598) - ScannerIoWaitTime: 5s360ms - ScannerThreadWorklessLoops: 39 (39) - ScannerThreadsInvoluntaryContextSwitches: 627 (627) - ScannerThreadsTotalWallClockTime: 20m19s - ScannerThreadsSysTime: 15s198ms - ScannerThreadsUserTime: 1m4s - ScannerThreadsVoluntaryContextSwitches: 546.94K (546943) - TotalRawHdfsOpenFileTime(*): 348.004ms - TotalRawHdfsReadTime(*): 1m4s - TotalReadThroughput: 109.29 MB/sec Buffer pool: - AllocTime: 1s164ms - CumulativeAllocationBytes: 11.39 GB (12230590464) - CumulativeAllocations: 1.78K (1784) - PeakReservation: 1.51 GB (1619001344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.31 GB (1405353984) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1s164ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1981581) - Rows rejected: 46.46K (46464) - Rows total: 550.67M (550668182) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935117) - Rows rejected: 23.21K (23211) - Rows total: 550.62M (550621718) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.88M (1882065) - Rows rejected: 12.24K (12241) - Rows total: 550.60M (550598507) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.85M (1853440) - Rows rejected: 0 (0) - Rows total: 550.59M (550586266) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 598 (598) - Files rejected: 482 (482) - Files total: 598 (598) - RowGroups processed: 537.71K (537705) - RowGroups rejected: 0 (0) - RowGroups total: 537.71K (537705) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 550.59M (550586266) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) CodeGen:(Total: 920.019ms, non-child: 920.019ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 920.019ms - CodegenSysTime: 4.027ms - CodegenUserTime: 915.857ms - CodegenVoluntaryContextSwitches: 5 (5) - CompileTime: 280.005ms - IrGenerationTime: 28.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 596.012ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 12.000ms Instance 554562a26c33f0c6:2ec25d2f0000001e (host=impala-executor-000-9:22000):(Total: 2m42s, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:39.824 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:603/138.82 GB Filter 0 arrival: 988ms Filter 2 arrival: 988ms Filter 8 arrival: 989ms Filter 4 arrival: 1s372ms Filter 6 arrival: 8s022ms Fragment Instance Lifecycle Event Timeline: 2m42s - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 2m42s (2m42s) - First Batch Produced: 2m42s (0.000ns) - First Batch Sent: 2m42s (0.000ns) - ExecInternal Finished: 2m42s (0.000ns) - MemoryUsage (4s000ms): 1.22 GB, 1.61 GB, 1.61 GB, 1.61 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.63 GB, 1.59 GB, 1.17 GB, 652.30 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB - ThreadUsage (4s000ms): 11, 15, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 9, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 8.33 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.64 GB (1761277232) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785885642) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 756.005ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 5s416ms - TotalThreadsInvoluntaryContextSwitches: 1.15K (1151) - TotalThreadsTotalWallClockTime: 22m31s - TotalThreadsSysTime: 32s977ms - TotalThreadsUserTime: 2m52s - TotalThreadsVoluntaryContextSwitches: 575.13K (575129) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m42s - ExecTreeOpenTime: 2m41s - PrepareTime: 4.000ms - ExecTreePrepareTime: 4.000ms KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 133.42 KB/sec ; Min: 133.42 KB/sec ; Max: 133.42 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 241.219us ; Min: 131.114us ; Max: 351.325us ; Number of samples: 2) - RpcRecvrTime: (Avg: 32.661us ; Min: 17.257us ; Max: 48.065us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 48.00 B (48) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m41s, non-child: 120.000ms, % non-child: 0.07%) Node Lifecycle Event Timeline: 2m42s - Open Started: 980.006ms (980.006ms) - Open Finished: 2m42s (2m41s) - First Batch Requested: 2m42s (0.000ns) - First Batch Returned: 2m42s (0.000ns) - Last Batch Returned: 2m42s (0.000ns) - Closed: 2m42s (0.000ns) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m41s, non-child: 716.005ms, % non-child: 0.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m42s - Open Started: 980.006ms (980.006ms) - Open Finished: 1m35s (1m34s) - First Batch Requested: 1m35s (0.000ns) - First Batch Returned: 1m35s (0.000ns) - Last Batch Returned: 2m42s (1m6s) - Closed: 2m42s (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.30M (6295828) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 708.005ms - RowsReturned: 8.29K (8293) - RowsReturnedRate: 51.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.29M (6293258) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 988.006ms - Open Started: 980.006ms (980.006ms) - Open Finished: 980.006ms (0.000ns) - First Batch Requested: 984.006ms (4.000ms) - First Batch Returned: 984.006ms (0.000ns) - Last Batch Returned: 984.006ms (0.000ns) - Closed: 988.006ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 19.484us ; Min: 13.933us ; Max: 26.737us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m40s, non-child: 200.001ms, % non-child: 0.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m42s - Open Started: 980.006ms (980.006ms) - Open Finished: 1m35s (1m34s) - First Batch Requested: 1m35s (0.000ns) - First Batch Returned: 1m35s (0.000ns) - Last Batch Returned: 2m42s (1m6s) - Closed: 2m42s (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.32M (6316566) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 188.001ms - RowsReturned: 6.30M (6295828) - RowsReturnedRate: 39.22 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.30M (6297328) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 988.006ms - Open Started: 980.006ms (980.006ms) - Open Finished: 980.006ms (0.000ns) - First Batch Requested: 984.006ms (4.000ms) - First Batch Returned: 984.006ms (0.000ns) - Last Batch Returned: 984.006ms (0.000ns) - Closed: 988.006ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 35.056us ; Min: 22.966us ; Max: 47.146us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m40s, non-child: 9s064ms, % non-child: 5.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m42s - Open Started: 980.006ms (980.006ms) - Open Finished: 1m35s (1m34s) - First Batch Requested: 1m35s (0.000ns) - First Batch Returned: 1m35s (0.000ns) - Last Batch Returned: 2m42s (1m6s) - Closed: 2m42s (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 364.002ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 74.16 MB (77764864) - ProbeRows: 6.35M (6353496) - ProbeRowsPartitioned: 4.73M (4731490) - ProbeTime: 1s492ms - RowsReturned: 6.32M (6316566) - RowsReturnedRate: 39.39 K/sec Buffer pool: - AllocTime: 12.000ms - CumulativeAllocationBytes: 802.00 MB (840957952) - CumulativeAllocations: 384 (384) - PeakReservation: 66.00 MB (69206016) - PeakUnpinnedBytes: 638.00 MB (668991488) - PeakUsedReservation: 66.00 MB (69206016) - ReadIoBytes: 72.00 MB (75497472) - ReadIoOps: 36 (36) - ReadIoWaitTime: 24.000ms - SystemAllocTime: 8.000ms - WriteIoBytes: 638.00 MB (668991488) - WriteIoOps: 319 (319) - WriteIoWaitTime: 20.000ms Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 300.002ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 96.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 12 (12) Hash Table: - HashBuckets: 4.46M (4456448) - HashCollisions: 0 (0) - Probes: 8.24M (8237366) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 88.000ms, non-child: 20.000ms, % non-child: 22.73%) Node Lifecycle Event Timeline: 1s432ms - Open Started: 980.006ms (980.006ms) - Open Finished: 980.006ms (0.000ns) - First Batch Requested: 984.006ms (4.000ms) - First Batch Returned: 984.006ms (0.000ns) - Last Batch Returned: 1s372ms (388.002ms) - Closed: 1s432ms (60.000ms) - ConvertRowBatchTime: 16.000ms - PeakMemoryUsage: 14.29 MB (14980724) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 21.83 M/sec Buffer pool: - AllocTime: 204.001ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 204.001ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 87.88 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 72.000ms - DataWaitTime: 68.000ms Enqueue: - BytesReceived (500.000ms): 4.77 MB, 4.77 MB, 40.22 MB - DeferredQueueSize (500.000ms): 9, 9, 0 - DispatchTime: (Avg: 24.992us ; Min: 5.424us ; Max: 2.457ms ; Number of samples: 1881) - DeserializeRowBatchTime: 316.002ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 980.226ms - TotalRPCsDeferred: 265 (265) HASH_JOIN_NODE (id=7):(Total: 2m31s, non-child: 2m16s, % non-child: 90.41%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m42s - Open Started: 980.006ms (980.006ms) - Open Finished: 8s064ms (7s084ms) - First Batch Requested: 8s064ms (0.000ns) - First Batch Returned: 8s092ms (28.000ms) - Last Batch Returned: 2m41s (2m33s) - Closed: 2m42s (1s036ms) - BuildRows: 31.53M (31525830) - BuildTime: 6s036ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 546.00M (546000606) - ProbeRowsPartitioned: 533.17M (533166003) - ProbeTime: 1m49s - RowsReturned: 6.35M (6353496) - RowsReturnedRate: 42.00 K/sec Buffer pool: - AllocTime: 4s620ms - CumulativeAllocationBytes: 70.64 GB (75845599232) - CumulativeAllocations: 35.67K (35670) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 38.69 GB (41544581120) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 30.95 GB (33227276288) - ReadIoOps: 15.84K (15844) - ReadIoWaitTime: 15s180ms - SystemAllocTime: 4s600ms - WriteIoBytes: 38.69 GB (41544581120) - WriteIoOps: 19.81K (19810) - WriteIoWaitTime: 30s600ms Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5s988ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 1s936ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 564.69M (564691833) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 1s008ms, non-child: 364.002ms, % non-child: 36.11%) Node Lifecycle Event Timeline: 8s064ms - Open Started: 980.006ms (980.006ms) - Open Finished: 980.006ms (0.000ns) - First Batch Requested: 988.006ms (8.000ms) - First Batch Returned: 988.006ms (0.000ns) - Last Batch Returned: 8s024ms (7s036ms) - Closed: 8s064ms (40.000ms) - ConvertRowBatchTime: 316.002ms - PeakMemoryUsage: 13.15 MB (13789410) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 31.28 M/sec Buffer pool: - AllocTime: 196.001ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 176.001ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 74.61 MB, 186.00 MB, 298.76 MB, 421.30 MB, 544.00 MB, 666.55 MB, 789.41 MB, 916.87 MB, 1.02 GB, 1.13 GB, 1.26 GB, 1.38 GB, 1.50 GB, 1.60 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 684.004ms - DataWaitTime: 644.004ms Enqueue: - BytesReceived (500.000ms): 4.64 MB, 4.64 MB, 36.69 MB, 83.16 MB, 136.65 MB, 188.47 MB, 243.16 MB, 299.62 MB, 355.19 MB, 409.82 MB, 466.05 MB, 522.01 MB, 574.88 MB, 631.11 MB, 687.15 MB, 735.91 MB - DeferredQueueSize (500.000ms): 8, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 18.714us ; Min: 6.680us ; Max: 1.308ms ; Number of samples: 30799) - DeserializeRowBatchTime: 1s636ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 1s243ms - TotalRPCsDeferred: 732 (732) HASH_JOIN_NODE (id=6):(Total: 13s520ms, non-child: 10s768ms, % non-child: 79.64%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m42s - Open Started: 980.006ms (980.006ms) - Open Finished: 1s092ms (112.000ms) - First Batch Requested: 8s064ms (6s972ms) - First Batch Returned: 8s064ms (0.000ns) - Last Batch Returned: 1m35s (1m27s) - Closed: 2m42s (1m6s) - BuildRows: 365 (365) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 546.00M (546000606) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s580ms - RowsReturned: 546.00M (546000606) - RowsReturnedRate: 40.38 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 546.00M (546000971) - Resizes: 0 (0) - Travel: 185.55M (185554460) EXCHANGE_NODE (id=12): Node Lifecycle Event Timeline: 988.006ms - Open Started: 980.006ms (980.006ms) - Open Finished: 980.006ms (0.000ns) - First Batch Requested: 988.006ms (8.000ms) - First Batch Returned: 988.006ms (0.000ns) - Last Batch Returned: 988.006ms (0.000ns) - Closed: 988.006ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 19.407us ; Min: 19.407us ; Max: 19.407us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s752ms, non-child: 2s752ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:603/138.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Not all filters arrived (arrived: [0, 2, 8], missing [4, 6]), waited for 11ms. Arrival delay: 1s000ms. Hdfs Read Thread Concurrency Bucket: 0:86.24% 1:6.878% 2:3.175% 3:1.058% 4:1.587% 5:0% 6:0.5291% 7:0% 8:0.5291% File Formats: PARQUET/SNAPPY:118 PARQUET/Unknown(Skipped):485 Node Lifecycle Event Timeline: 2m42s - Open Started: 980.006ms (980.006ms) - Open Finished: 984.006ms (4.000ms) - First Batch Requested: 988.006ms (4.000ms) - First Batch Returned: 1s092ms (104.000ms) - Last Batch Returned: 1m35s (1m34s) - Closed: 2m42s (1m6s) - BytesRead (2s000ms): 551.30 MB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.09 GB, 1.19 GB, 1.45 GB, 1.94 GB, 2.19 GB, 2.25 GB, 2.46 GB, 3.14 GB, 3.40 GB, 3.77 GB, 4.19 GB, 4.65 GB, 4.93 GB, 5.31 GB, 5.77 GB, 6.13 GB, 6.49 GB, 6.90 GB, 7.25 GB, 7.58 GB, 8.02 GB, 8.43 GB, 8.68 GB, 8.73 GB, 8.86 GB, 9.00 GB, 9.13 GB, 9.25 GB, 9.35 GB, 9.47 GB, 9.61 GB, 9.69 GB, 9.91 GB, 9.94 GB, 10.06 GB, 10.19 GB, 10.21 GB, 10.31 GB, 10.31 GB, 10.32 GB, 10.32 GB - FooterProcessingTime: (Avg: 305.086us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 118) - InitialRangeActualReservation: (Avg: 107.19 MB (112393129) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 118) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 118) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1215654364) ; Min: 472.47 MB (495423105) ; Max: 2.00 GB (2152479127) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.65 KB (41623) ; Min: 11.00 B (11) ; Max: 70.54 KB (72238) ; Number of samples: 262855) - ParquetRowGroupActualReservation: (Avg: 115.53 MB (121137186) ; Min: 88.00 MB (92274688) ; Max: 128.00 MB (134217728) ; Number of samples: 118) - ParquetRowGroupIdealReservation: (Avg: 117.97 MB (123696423) ; Min: 88.00 MB (92274688) ; Max: 144.00 MB (150994944) ; Number of samples: 118) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1931771116) ; Min: 485.44 MB (509021497) ; Max: 3.67 GB (3936144805) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.59 KB (66142) ; Min: 9.00 B (9) ; Max: 71.56 KB (73278) ; Number of samples: 262855) - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 12.48 - BytesRead: 10.32 GB (11078288239) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 1.89K (1891) - CachedFileHandlesMissCount: 4 (4) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.15 GB (10893248402) - DataCacheHitCount: 1.87K (1869) - DataCacheMissBytes: 176.47 MB (185039837) - DataCacheMissCount: 26 (26) - DataCachePartialHitCount: 8 (8) - DecompressionTime: 8s784ms - MaterializeTupleTime(*): 1m2s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 262.86K (262855) - NumRowGroups: 118 (118) - NumRowGroupsWithPageIndex: 118 (118) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.50 GB (1614294449) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 387.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.54 GB (33861109760) - RowBatchQueueGetWaitTime: 92.000ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 18m19s - RowBatchesEnqueued: 533.46K (533457) - RowsRead: 546.08M (546084782) - RowsReturned: 546.00M (546000606) - RowsReturnedRate: 198.40 M/sec - ScanRangesComplete: 603 (603) - ScannerIoWaitTime: 5s416ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 728 (728) - ScannerThreadsTotalWallClockTime: 19m41s - ScannerThreadsSysTime: 15s318ms - ScannerThreadsUserTime: 1m3s - ScannerThreadsVoluntaryContextSwitches: 543.48K (543478) - TotalRawHdfsOpenFileTime(*): 112.000ms - TotalRawHdfsReadTime(*): 27s248ms - TotalReadThroughput: 110.63 MB/sec Buffer pool: - AllocTime: 1s016ms - CumulativeAllocationBytes: 11.46 GB (12310265856) - CumulativeAllocations: 1.81K (1809) - PeakReservation: 1.47 GB (1577058304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.26 GB (1349255168) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1s016ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2016719) - Rows rejected: 47.96K (47958) - Rows total: 546.08M (546084782) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1968761) - Rows rejected: 23.92K (23923) - Rows total: 546.04M (546036824) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.90M (1898503) - Rows rejected: 12.29K (12295) - Rows total: 546.01M (546012901) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.87M (1869824) - Rows rejected: 0 (0) - Rows total: 546.00M (546000606) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 603 (603) - Files rejected: 485 (485) - Files total: 603 (603) - RowGroups processed: 533.22K (533221) - RowGroups rejected: 0 (0) - RowGroups total: 533.22K (533221) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 546.00M (546000606) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) CodeGen:(Total: 976.006ms, non-child: 976.006ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 15 (15) - CodegenTotalWallClockTime: 976.006ms - CodegenSysTime: 0.000ns - CodegenUserTime: 975.723ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 292.002ms - IrGenerationTime: 36.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 636.004ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 12.000ms Instance 554562a26c33f0c6:2ec25d2f00000019 (host=impala-executor-000-1:22000):(Total: 2m41s, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:39.232 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:604/139.24 GB Filter 0 arrival: 951ms Filter 2 arrival: 951ms Filter 8 arrival: 951ms Filter 4 arrival: 1s370ms Filter 6 arrival: 8s021ms Fragment Instance Lifecycle Event Timeline: 2m41s - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 2m41s (2m41s) - First Batch Produced: 2m41s (0.000ns) - First Batch Sent: 2m41s (0.000ns) - ExecInternal Finished: 2m41s (0.000ns) - MemoryUsage (4s000ms): 1.30 GB, 1.62 GB, 1.62 GB, 1.62 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.45 GB, 801.51 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB - ThreadUsage (4s000ms): 13, 15, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 12, 6, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 8.53 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.64 GB (1760474526) - PeakReservation: 1.60 GB (1713176576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785404996) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 415.999ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 16s147ms - TotalThreadsInvoluntaryContextSwitches: 950 (950) - TotalThreadsTotalWallClockTime: 22m54s - TotalThreadsSysTime: 32s044ms - TotalThreadsUserTime: 2m55s - TotalThreadsVoluntaryContextSwitches: 568.11K (568106) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m41s - ExecTreeOpenTime: 2m40s - PrepareTime: 4.000ms - ExecTreePrepareTime: 4.000ms KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 137.45 KB/sec ; Min: 137.45 KB/sec ; Max: 137.45 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 240.779us ; Min: 119.221us ; Max: 362.338us ; Number of samples: 2) - RpcRecvrTime: (Avg: 38.482us ; Min: 15.854us ; Max: 61.111us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m40s, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 2m41s - Open Started: 944.000ms (944.000ms) - Open Finished: 2m41s (2m40s) - First Batch Requested: 2m41s (0.000ns) - First Batch Returned: 2m41s (0.000ns) - Last Batch Returned: 2m41s (0.000ns) - Closed: 2m41s (0.000ns) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m40s, non-child: 640.000ms, % non-child: 0.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m41s - Open Started: 944.000ms (944.000ms) - Open Finished: 2m40s (2m39s) - First Batch Requested: 2m40s (0.000ns) - First Batch Returned: 2m40s (4.000ms) - Last Batch Returned: 2m41s (1s468ms) - Closed: 2m41s (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 7.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.29M (6289404) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 640.000ms - RowsReturned: 8.64K (8640) - RowsReturnedRate: 53.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.29M (6286452) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 952.000ms - Open Started: 944.000ms (944.000ms) - Open Finished: 944.000ms (0.000ns) - First Batch Requested: 948.000ms (3.999ms) - First Batch Returned: 948.000ms (0.000ns) - Last Batch Returned: 948.000ms (0.000ns) - Closed: 952.000ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 17.258us ; Min: 11.180us ; Max: 24.060us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m40s, non-child: 135.999ms, % non-child: 0.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m41s - Open Started: 944.000ms (944.000ms) - Open Finished: 2m40s (2m39s) - First Batch Requested: 2m40s (0.000ns) - First Batch Returned: 2m40s (0.000ns) - Last Batch Returned: 2m41s (1s472ms) - Closed: 2m41s (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 7.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.31M (6308964) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 76.000ms - RowsReturned: 6.29M (6289404) - RowsReturnedRate: 39.26 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.29M (6290904) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 952.000ms - Open Started: 944.000ms (944.000ms) - Open Finished: 944.000ms (0.000ns) - First Batch Requested: 948.000ms (3.999ms) - First Batch Returned: 948.000ms (0.000ns) - Last Batch Returned: 948.000ms (0.000ns) - Closed: 952.000ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 35.687us ; Min: 29.951us ; Max: 41.424us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m40s, non-child: 9s087ms, % non-child: 5.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m41s - Open Started: 944.000ms (944.000ms) - Open Finished: 1m36s (1m35s) - First Batch Requested: 1m36s (0.000ns) - First Batch Returned: 1m36s (0.000ns) - Last Batch Returned: 2m41s (1m5s) - Closed: 2m41s (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 415.998ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 44.16 MB (46307584) - ProbeRows: 6.35M (6348164) - ProbeRowsPartitioned: 6.31M (6308964) - ProbeTime: 1s855ms - RowsReturned: 6.31M (6308964) - RowsReturnedRate: 39.42 K/sec Buffer pool: - AllocTime: 7.999ms - CumulativeAllocationBytes: 982.00 MB (1029701632) - CumulativeAllocations: 475 (475) - PeakReservation: 36.00 MB (37748736) - PeakUnpinnedBytes: 854.00 MB (895483904) - PeakUsedReservation: 36.00 MB (37748736) - ReadIoBytes: 64.00 MB (67108864) - ReadIoOps: 32 (32) - ReadIoWaitTime: 15.999ms - SystemAllocTime: 7.999ms - WriteIoBytes: 854.00 MB (895483904) - WriteIoOps: 427 (427) - WriteIoWaitTime: 43.999ms Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 359.998ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 88.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.23M (8229764) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 63.999ms, non-child: 23.999ms, % non-child: 37.50%) Node Lifecycle Event Timeline: 1s423ms - Open Started: 944.000ms (944.000ms) - Open Finished: 944.000ms (0.000ns) - First Batch Requested: 948.000ms (3.999ms) - First Batch Returned: 948.000ms (0.000ns) - Last Batch Returned: 1s371ms (423.998ms) - Closed: 1s423ms (51.999ms) - ConvertRowBatchTime: 19.999ms - PeakMemoryUsage: 14.29 MB (14980432) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 30.01 M/sec Buffer pool: - AllocTime: 39.999ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.16 MB (14852096) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.16 MB (14852096) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 35.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 6.09 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 39.999ms - DataWaitTime: 39.999ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 4.91 MB - DeferredQueueSize (500.000ms): 10, 0 - DispatchTime: (Avg: 25.514us ; Min: 8.763us ; Max: 1.023ms ; Number of samples: 1881) - DeserializeRowBatchTime: 111.999ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 992.235ms - TotalRPCsDeferred: 117 (117) HASH_JOIN_NODE (id=7):(Total: 2m30s, non-child: 2m15s, % non-child: 90.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m41s - Open Started: 944.000ms (944.000ms) - Open Finished: 8s067ms (7s123ms) - First Batch Requested: 8s067ms (0.000ns) - First Batch Returned: 8s091ms (24.000ms) - Last Batch Returned: 2m40s (2m32s) - Closed: 2m41s (1s488ms) - BuildRows: 31.53M (31525830) - BuildTime: 6s391ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 545.34M (545344164) - ProbeRowsPartitioned: 532.52M (532516978) - ProbeTime: 1m47s - RowsReturned: 6.35M (6348164) - RowsReturnedRate: 42.05 K/sec Buffer pool: - AllocTime: 4s532ms - CumulativeAllocationBytes: 70.59 GB (75797364736) - CumulativeAllocations: 35.65K (35647) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 38.65 GB (41498443776) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 30.94 GB (33225179136) - ReadIoOps: 15.84K (15843) - ReadIoWaitTime: 15s123ms - SystemAllocTime: 4s488ms - WriteIoBytes: 38.65 GB (41498443776) - WriteIoOps: 19.79K (19788) - WriteIoWaitTime: 29s427ms Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6s335ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 1s995ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 564.04M (564042808) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 703.998ms, non-child: 547.998ms, % non-child: 77.84%) Node Lifecycle Event Timeline: 8s063ms - Open Started: 944.000ms (944.000ms) - Open Finished: 944.000ms (0.000ns) - First Batch Requested: 952.000ms (7.999ms) - First Batch Returned: 952.000ms (0.000ns) - Last Batch Returned: 8s023ms (7s071ms) - Closed: 8s063ms (40.000ms) - ConvertRowBatchTime: 323.999ms - PeakMemoryUsage: 13.19 MB (13831146) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 44.78 M/sec Buffer pool: - AllocTime: 67.999ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 13.07 MB (13705216) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 13.07 MB (13705216) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 19.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 2.95 MB, 92.70 MB, 204.85 MB, 325.92 MB, 448.03 MB, 566.36 MB, 692.07 MB, 821.06 MB, 938.08 MB, 1.04 GB, 1.16 GB, 1.28 GB, 1.40 GB, 1.53 GB, 1.64 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 375.999ms - DataWaitTime: 156.000ms Enqueue: - BytesReceived (500.000ms): 4.64 MB, 4.79 MB, 46.05 MB, 96.18 MB, 150.31 MB, 204.91 MB, 257.74 MB, 313.96 MB, 371.56 MB, 423.86 MB, 480.51 MB, 537.16 MB, 589.51 MB, 646.86 MB, 699.70 MB, 748.43 MB - DeferredQueueSize (500.000ms): 8, 0, 7, 7, 8, 9, 7, 8, 7, 6, 6, 6, 7, 1, 0, 0 - DispatchTime: (Avg: 18.275us ; Min: 6.087us ; Max: 4.918ms ; Number of samples: 30799) - DeserializeRowBatchTime: 1s579ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 6s744ms - TotalRPCsDeferred: 25.94K (25936) HASH_JOIN_NODE (id=6):(Total: 14s391ms, non-child: 11s215ms, % non-child: 77.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m41s - Open Started: 944.000ms (944.000ms) - Open Finished: 1s087ms (143.999ms) - First Batch Requested: 8s067ms (6s979ms) - First Batch Returned: 8s067ms (0.000ns) - Last Batch Returned: 1m36s (1m28s) - Closed: 2m41s (1m5s) - BuildRows: 365 (365) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 545.34M (545344164) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s963ms - RowsReturned: 545.34M (545344164) - RowsReturnedRate: 37.89 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 545.34M (545344529) - Resizes: 0 (0) - Travel: 199.71M (199709066) EXCHANGE_NODE (id=12): Node Lifecycle Event Timeline: 952.000ms - Open Started: 944.000ms (944.000ms) - Open Finished: 944.000ms (0.000ns) - First Batch Requested: 952.000ms (7.999ms) - First Batch Returned: 952.000ms (0.000ns) - Last Batch Returned: 952.000ms (0.000ns) - Closed: 952.000ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 12.621us ; Min: 12.621us ; Max: 12.621us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s175ms, non-child: 3s175ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:604/139.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 113 out of 113 Runtime filters: Not all filters arrived (arrived: [0, 2, 8], missing [4, 6]), waited for 48ms. Arrival delay: 1s000ms. Hdfs Read Thread Concurrency Bucket: 0:72.25% 1:14.66% 2:5.236% 3:3.141% 4:2.094% 5:0.5236% 6:1.047% 7:1.047% 8:0% File Formats: PARQUET/SNAPPY:113 PARQUET/Unknown(Skipped):491 Node Lifecycle Event Timeline: 2m41s - Open Started: 944.000ms (944.000ms) - Open Finished: 948.000ms (3.999ms) - First Batch Requested: 952.000ms (3.999ms) - First Batch Returned: 1s087ms (135.999ms) - Last Batch Returned: 1m36s (1m35s) - Closed: 2m41s (1m5s) - BytesRead (2s000ms): 547.53 MB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.15 GB, 1.17 GB, 1.22 GB, 1.34 GB, 1.82 GB, 2.32 GB, 2.35 GB, 2.51 GB, 3.02 GB, 3.53 GB, 3.69 GB, 4.06 GB, 4.64 GB, 4.91 GB, 5.16 GB, 5.78 GB, 6.08 GB, 6.39 GB, 6.83 GB, 7.20 GB, 7.56 GB, 7.85 GB, 8.15 GB, 8.28 GB, 8.53 GB, 8.71 GB, 8.81 GB, 8.92 GB, 9.00 GB, 9.03 GB, 9.19 GB, 9.29 GB, 9.51 GB, 9.65 GB, 9.89 GB, 10.03 GB, 10.14 GB, 10.20 GB, 10.24 GB, 10.26 GB, 10.26 GB, 10.27 GB, 10.29 GB - FooterProcessingTime: (Avg: 247.786us ; Min: 0.000ns ; Max: 19.999ms ; Number of samples: 113) - InitialRangeActualReservation: (Avg: 109.95 MB (115287683) ; Min: 40.00 MB (41943040) ; Max: 144.00 MB (150994944) ; Number of samples: 113) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 113) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1215216797) ; Min: 471.87 MB (494794962) ; Max: 2.00 GB (2150538827) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.61 KB (41583) ; Min: 11.00 B (11) ; Max: 70.28 KB (71968) ; Number of samples: 263013) - ParquetRowGroupActualReservation: (Avg: 119.01 MB (124789823) ; Min: 48.00 MB (50331648) ; Max: 144.00 MB (150994944) ; Number of samples: 113) - ParquetRowGroupIdealReservation: (Avg: 121.98 MB (127907713) ; Min: 88.00 MB (92274688) ; Max: 144.00 MB (150994944) ; Number of samples: 113) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1933227085) ; Min: 484.80 MB (508351277) ; Max: 3.68 GB (3946555717) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.60 KB (66152) ; Min: 9.00 B (9) ; Max: 71.27 KB (72977) ; Number of samples: 263013) - AverageHdfsReadThreadConcurrency: 0.59 - AverageScannerThreadConcurrency: 12.64 - BytesRead: 10.31 GB (11068797397) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 1.95K (1947) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 9.94 GB (10677156896) - DataCacheHitCount: 1.83K (1828) - DataCacheMissBytes: 373.50 MB (391640501) - DataCacheMissCount: 125 (125) - DataCachePartialHitCount: 87 (87) - DecompressionTime: 8s735ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 263.01K (263013) - NumRowGroups: 113 (113) - NumRowGroupsWithPageIndex: 113 (113) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 GB (1657532926) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 171.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.50 GB (33820456960) - RowBatchQueueGetWaitTime: 395.999ms - RowBatchQueuePeakMemoryUsage: 6.48 MB (6793216) - RowBatchQueuePutWaitTime: 18m30s - RowBatchesEnqueued: 532.81K (532812) - RowsRead: 545.42M (545424005) - RowsReturned: 545.34M (545344164) - RowsReturnedRate: 171.71 M/sec - ScanRangesComplete: 604 (604) - ScannerIoWaitTime: 16s147ms - ScannerThreadWorklessLoops: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 661 (661) - ScannerThreadsTotalWallClockTime: 20m4s - ScannerThreadsSysTime: 14s980ms - ScannerThreadsUserTime: 1m5s - ScannerThreadsVoluntaryContextSwitches: 540.70K (540703) - TotalRawHdfsOpenFileTime(*): 195.999ms - TotalRawHdfsReadTime(*): 1m1s - TotalReadThroughput: 109.82 MB/sec Buffer pool: - AllocTime: 959.998ms - CumulativeAllocationBytes: 11.06 GB (11878023168) - CumulativeAllocations: 1.75K (1755) - PeakReservation: 1.51 GB (1619001344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.29 GB (1387806720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 959.998ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1930887) - Rows rejected: 45.74K (45737) - Rows total: 545.42M (545424005) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.89M (1885150) - Rows rejected: 22.71K (22711) - Rows total: 545.38M (545378268) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.82M (1816705) - Rows rejected: 11.39K (11393) - Rows total: 545.36M (545355557) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.80M (1804288) - Rows rejected: 0 (0) - Rows total: 545.34M (545344164) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 604 (604) - Files rejected: 491 (491) - Files total: 604 (604) - RowGroups processed: 532.59K (532586) - RowGroups rejected: 0 (0) - RowGroups total: 532.59K (532586) - Rows processed: 1.85M (1851392) - Rows rejected: 0 (0) - Rows total: 545.34M (545344164) - Splits processed: 113 (113) - Splits rejected: 0 (0) - Splits total: 113 (113) CodeGen:(Total: 940.000ms, non-child: 940.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 940.000ms - CodegenSysTime: 7.971ms - CodegenUserTime: 931.893ms - CodegenVoluntaryContextSwitches: 5 (5) - CompileTime: 291.999ms - IrGenerationTime: 32.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 604.000ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 12.000ms Instance 554562a26c33f0c6:2ec25d2f0000001a (host=impala-executor-000-8:22000):(Total: 2m41s, non-child: 3.999ms, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:38.468 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:599/138.92 GB Filter 0 arrival: 922ms Filter 2 arrival: 921ms Filter 8 arrival: 921ms Filter 4 arrival: 1s369ms Filter 6 arrival: 8s018ms Fragment Instance Lifecycle Event Timeline: 2m41s - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 2m41s (2m40s) - First Batch Produced: 2m41s (0.000ns) - First Batch Sent: 2m41s (0.000ns) - ExecInternal Finished: 2m41s (0.000ns) - MemoryUsage (4s000ms): 1.25 GB, 1.65 GB, 1.64 GB, 1.65 GB, 1.65 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.65 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.65 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.55 GB, 1.25 GB, 846.69 MB, 241.70 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.19 MB - ThreadUsage (4s000ms): 13, 18, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 17, 16, 13, 9, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 10.20 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1780795266) - PeakReservation: 1.60 GB (1717370880) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785237502) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 2s044ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 12s139ms - TotalThreadsInvoluntaryContextSwitches: 888 (888) - TotalThreadsTotalWallClockTime: 27m25s - TotalThreadsSysTime: 31s018ms - TotalThreadsUserTime: 2m50s - TotalThreadsVoluntaryContextSwitches: 582.88K (582884) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m40s - ExecTreeOpenTime: 2m40s - PrepareTime: 3.999ms - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 187.37 KB/sec ; Min: 187.37 KB/sec ; Max: 187.37 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 189.134us ; Min: 112.459us ; Max: 265.810us ; Number of samples: 2) - RpcRecvrTime: (Avg: 30.262us ; Min: 15.820us ; Max: 44.704us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m40s, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 2m41s - Open Started: 916.001ms (916.001ms) - Open Finished: 2m41s (2m40s) - First Batch Requested: 2m41s (0.000ns) - First Batch Returned: 2m41s (0.000ns) - Last Batch Returned: 2m41s (0.000ns) - Closed: 2m41s (0.000ns) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m40s, non-child: 604.001ms, % non-child: 0.38%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m41s - Open Started: 916.001ms (916.001ms) - Open Finished: 2m39s (2m38s) - First Batch Requested: 2m39s (0.000ns) - First Batch Returned: 2m39s (4.000ms) - Last Batch Returned: 2m41s (1s308ms) - Closed: 2m41s (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.34M (6336576) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 604.001ms - RowsReturned: 9.51K (9511) - RowsReturnedRate: 59.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 4.000ms - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.34M (6335068) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 924.001ms - Open Started: 916.001ms (916.001ms) - Open Finished: 916.001ms (0.000ns) - First Batch Requested: 916.001ms (0.000ns) - First Batch Returned: 916.001ms (0.000ns) - Last Batch Returned: 920.001ms (4.000ms) - Closed: 924.001ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 24.095us ; Min: 14.471us ; Max: 51.017us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m39s, non-child: 144.000ms, % non-child: 0.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m41s - Open Started: 916.001ms (916.001ms) - Open Finished: 2m39s (2m38s) - First Batch Requested: 2m39s (0.000ns) - First Batch Returned: 2m39s (0.000ns) - Last Batch Returned: 2m41s (1s312ms) - Closed: 2m41s (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.36M (6356368) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 92.000ms - RowsReturned: 6.34M (6336576) - RowsReturnedRate: 39.73 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.34M (6338076) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 924.001ms - Open Started: 916.001ms (916.001ms) - Open Finished: 916.001ms (0.000ns) - First Batch Requested: 920.001ms (4.000ms) - First Batch Returned: 920.001ms (0.000ns) - Last Batch Returned: 920.001ms (0.000ns) - Closed: 924.001ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 31.615us ; Min: 24.336us ; Max: 38.895us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m39s, non-child: 9s059ms, % non-child: 5.69%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m41s - Open Started: 916.001ms (916.001ms) - Open Finished: 1m36s (1m35s) - First Batch Requested: 1m36s (0.000ns) - First Batch Returned: 1m36s (4.000ms) - Last Batch Returned: 2m41s (1m4s) - Closed: 2m41s (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 368.001ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 44.22 MB (46371072) - ProbeRows: 6.40M (6395716) - ProbeRowsPartitioned: 6.36M (6356368) - ProbeTime: 1s596ms - RowsReturned: 6.36M (6356368) - RowsReturnedRate: 39.89 K/sec Buffer pool: - AllocTime: 28.000ms - CumulativeAllocationBytes: 1018.00 MB (1067450368) - CumulativeAllocations: 493 (493) - PeakReservation: 36.00 MB (37748736) - PeakUnpinnedBytes: 858.00 MB (899678208) - PeakUsedReservation: 36.00 MB (37748736) - ReadIoBytes: 96.00 MB (100663296) - ReadIoOps: 48 (48) - ReadIoWaitTime: 36.000ms - SystemAllocTime: 28.000ms - WriteIoBytes: 858.00 MB (899678208) - WriteIoOps: 429 (429) - WriteIoWaitTime: 56.000ms Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 324.000ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 80.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.28M (8277168) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 124.000ms, non-child: 32.000ms, % non-child: 25.81%) Node Lifecycle Event Timeline: 1s412ms - Open Started: 916.001ms (916.001ms) - Open Finished: 916.001ms (0.000ns) - First Batch Requested: 920.001ms (4.000ms) - First Batch Returned: 920.001ms (0.000ns) - Last Batch Returned: 1s372ms (452.001ms) - Closed: 1s412ms (40.000ms) - ConvertRowBatchTime: 24.000ms - PeakMemoryUsage: 14.29 MB (14988875) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 15.49 M/sec Buffer pool: - AllocTime: 48.000ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.09 MB (14778368) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.09 MB (14778368) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 44.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 76.03 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 100.000ms - DataWaitTime: 92.000ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 4.79 MB, 39.47 MB - DeferredQueueSize (500.000ms): 10, 10, 5 - DispatchTime: (Avg: 25.662us ; Min: 7.075us ; Max: 1.828ms ; Number of samples: 1881) - DeserializeRowBatchTime: 136.000ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 1s033ms - TotalRPCsDeferred: 652 (652) HASH_JOIN_NODE (id=7):(Total: 2m30s, non-child: 2m15s, % non-child: 89.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m41s - Open Started: 916.001ms (916.001ms) - Open Finished: 8s064ms (7s148ms) - First Batch Requested: 8s064ms (0.000ns) - First Batch Returned: 8s092ms (28.000ms) - Last Batch Returned: 2m39s (2m31s) - Closed: 2m41s (1s340ms) - BuildRows: 31.53M (31525830) - BuildTime: 4s808ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 549.03M (549030991) - ProbeRowsPartitioned: 536.14M (536143401) - ProbeTime: 1m48s - RowsReturned: 6.40M (6395716) - RowsReturnedRate: 42.56 K/sec Buffer pool: - AllocTime: 3s496ms - CumulativeAllocationBytes: 71.08 GB (76321652736) - CumulativeAllocations: 35.90K (35897) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 38.90 GB (41771073536) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 31.18 GB (33476837376) - ReadIoOps: 15.96K (15963) - ReadIoWaitTime: 15s260ms - SystemAllocTime: 3s484ms - WriteIoBytes: 38.90 GB (41771073536) - WriteIoOps: 19.92K (19918) - WriteIoWaitTime: 32s135ms Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 4s756ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 1s844ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 567.67M (567669231) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 2s320ms, non-child: 408.001ms, % non-child: 17.59%) Node Lifecycle Event Timeline: 8s064ms - Open Started: 916.001ms (916.001ms) - Open Finished: 916.001ms (0.000ns) - First Batch Requested: 924.001ms (8.000ms) - First Batch Returned: 924.001ms (0.000ns) - Last Batch Returned: 8s020ms (7s096ms) - Closed: 8s064ms (44.000ms) - ConvertRowBatchTime: 368.001ms - PeakMemoryUsage: 13.15 MB (13789143) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 13.59 M/sec Buffer pool: - AllocTime: 48.000ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 32.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 71.93 MB, 177.42 MB, 296.68 MB, 418.29 MB, 534.66 MB, 660.92 MB, 785.70 MB, 907.53 MB, 1.01 GB, 1.13 GB, 1.25 GB, 1.37 GB, 1.49 GB, 1.60 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 1s936ms - DataWaitTime: 1s912ms Enqueue: - BytesReceived (500.000ms): 4.62 MB, 4.62 MB, 33.22 MB, 79.32 MB, 132.60 MB, 188.15 MB, 238.98 MB, 295.39 MB, 353.29 MB, 405.61 MB, 461.87 MB, 518.84 MB, 572.14 MB, 627.30 MB, 683.60 MB, 732.44 MB - DeferredQueueSize (500.000ms): 7, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 15.400us ; Min: 4.857us ; Max: 4.236ms ; Number of samples: 30799) - DeserializeRowBatchTime: 1s324ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 877.600ms - TotalRPCsDeferred: 25 (25) HASH_JOIN_NODE (id=6):(Total: 13s007ms, non-child: 10s115ms, % non-child: 77.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m41s - Open Started: 916.001ms (916.001ms) - Open Finished: 1s092ms (176.000ms) - First Batch Requested: 8s064ms (6s972ms) - First Batch Returned: 8s064ms (0.000ns) - Last Batch Returned: 1m36s (1m28s) - Closed: 2m41s (1m4s) - BuildRows: 365 (365) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 549.03M (549030991) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 9s851ms - RowsReturned: 549.03M (549030991) - RowsReturnedRate: 42.21 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 549.03M (549031356) - Resizes: 0 (0) - Travel: 129.51M (129509803) EXCHANGE_NODE (id=12): Node Lifecycle Event Timeline: 924.001ms - Open Started: 916.001ms (916.001ms) - Open Finished: 916.001ms (0.000ns) - First Batch Requested: 920.001ms (4.000ms) - First Batch Returned: 920.001ms (0.000ns) - Last Batch Returned: 920.001ms (0.000ns) - Closed: 924.001ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 20.080us ; Min: 20.080us ; Max: 20.080us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s891ms, non-child: 2s891ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:599/138.92 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: Not all filters arrived (arrived: [0, 2, 8], missing [4, 6]), waited for 78ms. Arrival delay: 1s000ms. Hdfs Read Thread Concurrency Bucket: 0:80.1% 1:9.424% 2:3.665% 3:2.618% 4:1.571% 5:1.047% 6:0.5236% 7:0% 8:1.047% File Formats: PARQUET/SNAPPY:115 PARQUET/Unknown(Skipped):484 Node Lifecycle Event Timeline: 2m41s - Open Started: 916.001ms (916.001ms) - Open Finished: 916.001ms (0.000ns) - First Batch Requested: 924.001ms (8.000ms) - First Batch Returned: 1s092ms (168.000ms) - Last Batch Returned: 1m36s (1m35s) - Closed: 2m41s (1m4s) - BytesRead (2s000ms): 570.63 MB, 1.20 GB, 1.20 GB, 1.20 GB, 1.21 GB, 1.22 GB, 1.32 GB, 1.38 GB, 1.44 GB, 1.60 GB, 2.16 GB, 2.68 GB, 2.83 GB, 2.96 GB, 3.51 GB, 4.19 GB, 4.34 GB, 4.48 GB, 5.11 GB, 5.68 GB, 5.82 GB, 6.07 GB, 6.82 GB, 7.16 GB, 7.30 GB, 7.56 GB, 7.90 GB, 8.20 GB, 8.41 GB, 8.56 GB, 8.57 GB, 8.60 GB, 8.63 GB, 8.70 GB, 8.88 GB, 9.10 GB, 9.21 GB, 9.38 GB, 9.60 GB, 9.80 GB, 9.92 GB, 10.03 GB, 10.16 GB, 10.18 GB, 10.26 GB, 10.28 GB, 10.31 GB, 10.35 GB - FooterProcessingTime: (Avg: 347.825us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 115) - InitialRangeActualReservation: (Avg: 88.77 MB (93077076) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 115) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 115) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.14 GB (1222201406) ; Min: 475.06 MB (498139840) ; Max: 2.02 GB (2164928141) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.58 KB (41556) ; Min: 11.00 B (11) ; Max: 70.60 KB (72293) ; Number of samples: 264693) - ParquetRowGroupActualReservation: (Avg: 96.66 MB (101356267) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 115) - ParquetRowGroupIdealReservation: (Avg: 121.29 MB (127178591) ; Min: 88.00 MB (92274688) ; Max: 136.00 MB (142606336) ; Number of samples: 115) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.81 GB (1945185217) ; Min: 488.07 MB (511778810) ; Max: 3.70 GB (3969883094) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.59 KB (66139) ; Min: 9.00 B (9) ; Max: 71.65 KB (73365) ; Number of samples: 264693) - AverageHdfsReadThreadConcurrency: 0.50 - AverageScannerThreadConcurrency: 15.44 - BytesRead: 10.37 GB (11133927420) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 2.63K (2635) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.00 GB (10736847380) - DataCacheHitCount: 2.56K (2558) - DataCacheMissBytes: 378.69 MB (397080040) - DataCacheMissCount: 83 (83) - DataCachePartialHitCount: 27 (27) - DecompressionTime: 8s763ms - MaterializeTupleTime(*): 1m - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 264.69K (264693) - NumRowGroups: 115 (115) - NumRowGroupsWithPageIndex: 115 (115) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 16 (16) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.56 GB (1670532716) - PeakScannerThreadConcurrency: 16 (16) - PerReadThreadRawHdfsThroughput: 203.46 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.71 GB (34048958464) - RowBatchQueueGetWaitTime: 208.000ms - RowBatchQueuePeakMemoryUsage: 6.62 MB (6944768) - RowBatchQueuePutWaitTime: 23m9s - RowBatchesEnqueued: 536.41K (536413) - RowsRead: 549.11M (549111967) - RowsReturned: 549.03M (549030991) - RowsReturnedRate: 189.85 M/sec - ScanRangesComplete: 599 (599) - ScannerIoWaitTime: 12s139ms - ScannerThreadWorklessLoops: 48 (48) - ScannerThreadsInvoluntaryContextSwitches: 542 (542) - ScannerThreadsTotalWallClockTime: 24m37s - ScannerThreadsSysTime: 14s561ms - ScannerThreadsUserTime: 1m3s - ScannerThreadsVoluntaryContextSwitches: 545.54K (545542) - TotalRawHdfsOpenFileTime(*): 199.999ms - TotalRawHdfsReadTime(*): 52s188ms - TotalReadThroughput: 110.03 MB/sec Buffer pool: - AllocTime: 1s104ms - CumulativeAllocationBytes: 9.46 GB (10162667520) - CumulativeAllocations: 1.60K (1596) - PeakReservation: 1.51 GB (1623195648) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.35 GB (1445199872) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1s104ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.96M (1964541) - Rows rejected: 46.00K (46000) - Rows total: 549.11M (549111967) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.92M (1918541) - Rows rejected: 23.23K (23232) - Rows total: 549.07M (549065967) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.85M (1847776) - Rows rejected: 11.74K (11744) - Rows total: 549.04M (549042735) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.83M (1833984) - Rows rejected: 0 (0) - Rows total: 549.03M (549030991) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 599 (599) - Files rejected: 484 (484) - Files total: 599 (599) - RowGroups processed: 536.18K (536183) - RowGroups rejected: 0 (0) - RowGroups total: 536.18K (536183) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 549.03M (549030991) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) CodeGen:(Total: 912.001ms, non-child: 912.001ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 912.001ms - CodegenSysTime: 7.966ms - CodegenUserTime: 903.987ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 280.000ms - IrGenerationTime: 27.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 592.001ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f0000001d (host=impala-executor-000-0:22000):(Total: 2m40s, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:37.922 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:604/139.01 GB Filter 0 arrival: 937ms Filter 2 arrival: 937ms Filter 8 arrival: 937ms Filter 4 arrival: 1s367ms Filter 6 arrival: 8s041ms Fragment Instance Lifecycle Event Timeline: 2m40s - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 2m40s (2m40s) - First Batch Produced: 2m40s (0.000ns) - First Batch Sent: 2m40s (0.000ns) - ExecInternal Finished: 2m40s (0.000ns) - MemoryUsage (4s000ms): 1.29 GB, 1.61 GB, 1.61 GB, 1.61 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.63 GB, 1.64 GB, 1.64 GB, 1.63 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.46 GB, 1.25 GB, 627.16 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.18 MB, 250.19 MB - ThreadUsage (4s000ms): 13, 15, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 12, 10, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 8.45 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.64 GB (1762478290) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1787538877) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1s095ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 6s015ms - TotalThreadsInvoluntaryContextSwitches: 1.08K (1078) - TotalThreadsTotalWallClockTime: 22m30s - TotalThreadsSysTime: 32s428ms - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 574.84K (574840) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m40s - ExecTreeOpenTime: 2m39s - PrepareTime: 3.999ms - ExecTreePrepareTime: 3.999ms KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 133.78 KB/sec ; Min: 133.78 KB/sec ; Max: 133.78 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 246.234us ; Min: 120.192us ; Max: 372.276us ; Number of samples: 2) - RpcRecvrTime: (Avg: 32.378us ; Min: 18.108us ; Max: 46.651us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m39s, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 2m40s - Open Started: 931.997ms (931.997ms) - Open Finished: 2m40s (2m39s) - First Batch Requested: 2m40s (0.000ns) - First Batch Returned: 2m40s (0.000ns) - Last Batch Returned: 2m40s (0.000ns) - Closed: 2m40s (0.000ns) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m39s, non-child: 583.998ms, % non-child: 0.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m40s - Open Started: 931.997ms (931.997ms) - Open Finished: 2m39s (2m38s) - First Batch Requested: 2m39s (0.000ns) - First Batch Returned: 2m39s (3.999ms) - Last Batch Returned: 2m40s (1s347ms) - Closed: 2m40s (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 7.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.29M (6285167) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 583.998ms - RowsReturned: 8.51K (8510) - RowsReturnedRate: 53.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 3.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.28M (6283036) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 939.997ms - Open Started: 931.997ms (931.997ms) - Open Finished: 931.997ms (0.000ns) - First Batch Requested: 931.997ms (0.000ns) - First Batch Returned: 931.997ms (0.000ns) - Last Batch Returned: 931.997ms (0.000ns) - Closed: 939.997ms (7.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 23.678us ; Min: 14.391us ; Max: 33.105us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m38s, non-child: 131.999ms, % non-child: 0.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m40s - Open Started: 931.997ms (931.997ms) - Open Finished: 2m39s (2m38s) - First Batch Requested: 2m39s (0.000ns) - First Batch Returned: 2m39s (0.000ns) - Last Batch Returned: 2m40s (1s351ms) - Closed: 2m40s (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.30M (6304167) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 75.999ms - RowsReturned: 6.29M (6285167) - RowsReturnedRate: 39.54 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.29M (6286667) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 935.997ms - Open Started: 931.997ms (931.997ms) - Open Finished: 931.997ms (0.000ns) - First Batch Requested: 931.997ms (0.000ns) - First Batch Returned: 931.997ms (0.000ns) - Last Batch Returned: 931.997ms (0.000ns) - Closed: 935.997ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 30.881us ; Min: 19.723us ; Max: 42.039us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m38s, non-child: 9s347ms, % non-child: 5.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m40s - Open Started: 931.997ms (931.997ms) - Open Finished: 1m35s (1m34s) - First Batch Requested: 1m35s (0.000ns) - First Batch Returned: 1m35s (0.000ns) - Last Batch Returned: 2m40s (1m5s) - Closed: 2m40s (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 331.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.22 MB (44273920) - ProbeRows: 6.34M (6342663) - ProbeRowsPartitioned: 6.30M (6304167) - ProbeTime: 1s635ms - RowsReturned: 6.30M (6304167) - RowsReturnedRate: 39.70 K/sec Buffer pool: - AllocTime: 39.999ms - CumulativeAllocationBytes: 1012.00 MB (1061158912) - CumulativeAllocations: 490 (490) - PeakReservation: 34.00 MB (35651584) - PeakUnpinnedBytes: 852.00 MB (893386752) - PeakUsedReservation: 34.00 MB (35651584) - ReadIoBytes: 96.00 MB (100663296) - ReadIoOps: 48 (48) - ReadIoWaitTime: 39.999ms - SystemAllocTime: 39.999ms - WriteIoBytes: 852.00 MB (893386752) - WriteIoOps: 426 (426) - WriteIoWaitTime: 43.999ms Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 291.999ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 83.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.22M (8224967) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 143.999ms, non-child: 19.999ms, % non-child: 13.89%) Node Lifecycle Event Timeline: 1s407ms - Open Started: 931.997ms (931.997ms) - Open Finished: 931.997ms (0.000ns) - First Batch Requested: 931.997ms (0.000ns) - First Batch Returned: 931.997ms (0.000ns) - Last Batch Returned: 1s367ms (435.998ms) - Closed: 1s407ms (39.999ms) - ConvertRowBatchTime: 15.999ms - PeakMemoryUsage: 14.29 MB (14980349) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 13.34 M/sec Buffer pool: - AllocTime: 23.999ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 23.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 11.94 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 123.999ms - DataWaitTime: 123.999ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 5.53 MB - DeferredQueueSize (500.000ms): 10, 0 - DispatchTime: (Avg: 29.113us ; Min: 8.399us ; Max: 5.498ms ; Number of samples: 1881) - DeserializeRowBatchTime: 123.999ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 925.180ms - TotalRPCsDeferred: 28 (28) HASH_JOIN_NODE (id=7):(Total: 2m29s, non-child: 2m14s, % non-child: 89.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m40s - Open Started: 931.997ms (931.997ms) - Open Finished: 8s083ms (7s151ms) - First Batch Requested: 8s083ms (0.000ns) - First Batch Returned: 8s111ms (27.999ms) - Last Batch Returned: 2m39s (2m30s) - Closed: 2m40s (1s375ms) - BuildRows: 31.53M (31525830) - BuildTime: 5s827ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 547.23M (547227783) - ProbeRowsPartitioned: 534.36M (534363267) - ProbeTime: 1m46s - RowsReturned: 6.34M (6342663) - RowsReturnedRate: 42.44 K/sec Buffer pool: - AllocTime: 4s203ms - CumulativeAllocationBytes: 70.84 GB (76059508736) - CumulativeAllocations: 35.77K (35772) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 38.78 GB (41636855808) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 31.06 GB (33348911104) - ReadIoOps: 15.90K (15902) - ReadIoWaitTime: 15s435ms - SystemAllocTime: 4s191ms - WriteIoBytes: 38.78 GB (41636855808) - WriteIoOps: 19.85K (19854) - WriteIoWaitTime: 27s919ms Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5s779ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 2s003ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 565.89M (565889097) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 1s291ms, non-child: 391.998ms, % non-child: 30.34%) Node Lifecycle Event Timeline: 8s083ms - Open Started: 931.997ms (931.997ms) - Open Finished: 931.997ms (0.000ns) - First Batch Requested: 935.997ms (3.999ms) - First Batch Returned: 935.997ms (0.000ns) - Last Batch Returned: 8s039ms (7s103ms) - Closed: 8s083ms (43.999ms) - ConvertRowBatchTime: 311.999ms - PeakMemoryUsage: 13.15 MB (13789000) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 24.40 M/sec Buffer pool: - AllocTime: 95.999ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 12.98 MB (13606912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.98 MB (13606912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 47.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 10.77 MB, 111.28 MB, 223.27 MB, 339.64 MB, 459.72 MB, 585.05 MB, 709.34 MB, 830.13 MB, 956.28 MB, 1.06 GB, 1.17 GB, 1.30 GB, 1.42 GB, 1.53 GB, 1.63 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 963.997ms - DataWaitTime: 899.997ms Enqueue: - BytesReceived (500.000ms): 4.64 MB, 4.81 MB, 49.79 MB, 99.84 MB, 154.15 MB, 205.49 MB, 261.51 MB, 317.72 MB, 371.90 MB, 427.43 MB, 484.13 MB, 538.75 MB, 593.10 MB, 650.85 MB, 702.73 MB, 751.38 MB - DeferredQueueSize (500.000ms): 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0 - DispatchTime: (Avg: 18.476us ; Min: 5.616us ; Max: 3.732ms ; Number of samples: 30799) - DeserializeRowBatchTime: 1s535ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 1s808ms - TotalRPCsDeferred: 3.72K (3723) HASH_JOIN_NODE (id=6):(Total: 13s855ms, non-child: 11s031ms, % non-child: 79.62%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m40s - Open Started: 931.997ms (931.997ms) - Open Finished: 1s087ms (155.999ms) - First Batch Requested: 8s083ms (6s995ms) - First Batch Returned: 8s083ms (0.000ns) - Last Batch Returned: 1m34s (1m26s) - Closed: 2m40s (1m5s) - BuildRows: 365 (365) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 547.23M (547227783) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s807ms - RowsReturned: 547.23M (547227783) - RowsReturnedRate: 39.49 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 547.23M (547228148) - Resizes: 0 (0) - Travel: 178.77M (178768439) EXCHANGE_NODE (id=12): Node Lifecycle Event Timeline: 939.997ms - Open Started: 931.997ms (931.997ms) - Open Finished: 931.997ms (0.000ns) - First Batch Requested: 935.997ms (3.999ms) - First Batch Returned: 935.997ms (0.000ns) - Last Batch Returned: 935.997ms (0.000ns) - Closed: 939.997ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 20.295us ; Min: 20.295us ; Max: 20.295us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s823ms, non-child: 2s823ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:604/139.01 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Not all filters arrived (arrived: [0, 2, 8], missing [4, 6]), waited for 62ms. Arrival delay: 1s000ms. Hdfs Read Thread Concurrency Bucket: 0:76.06% 1:6.383% 2:8.511% 3:3.723% 4:4.255% 5:0.5319% 6:0.5319% 7:0% 8:0% File Formats: PARQUET/SNAPPY:116 PARQUET/Unknown(Skipped):488 Node Lifecycle Event Timeline: 2m40s - Open Started: 931.997ms (931.997ms) - Open Finished: 931.997ms (0.000ns) - First Batch Requested: 939.997ms (7.999ms) - First Batch Returned: 1s087ms (147.999ms) - Last Batch Returned: 1m34s (1m33s) - Closed: 2m40s (1m5s) - BytesRead (2s000ms): 564.28 MB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.15 GB, 1.22 GB, 1.35 GB, 1.90 GB, 2.31 GB, 2.35 GB, 2.47 GB, 3.06 GB, 3.53 GB, 3.64 GB, 4.03 GB, 4.63 GB, 4.76 GB, 5.24 GB, 5.71 GB, 5.90 GB, 6.43 GB, 6.86 GB, 7.05 GB, 7.58 GB, 7.91 GB, 8.16 GB, 8.21 GB, 8.51 GB, 8.70 GB, 8.85 GB, 8.98 GB, 9.12 GB, 9.18 GB, 9.30 GB, 9.45 GB, 9.47 GB, 9.56 GB, 9.96 GB, 10.04 GB, 10.14 GB, 10.28 GB, 10.34 GB, 10.34 GB, 10.34 GB, 10.35 GB - FooterProcessingTime: (Avg: 551.722us ; Min: 0.000ns ; Max: 7.999ms ; Number of samples: 116) - InitialRangeActualReservation: (Avg: 110.45 MB (115813411) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 116) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 116) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.14 GB (1219470307) ; Min: 473.53 MB (496532174) ; Max: 2.01 GB (2157670419) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.64 KB (41616) ; Min: 11.00 B (11) ; Max: 70.22 KB (71903) ; Number of samples: 263722) - ParquetRowGroupActualReservation: (Avg: 119.31 MB (125105964) ; Min: 64.00 MB (67108864) ; Max: 136.00 MB (142606336) ; Number of samples: 116) - ParquetRowGroupIdealReservation: (Avg: 120.04 MB (125875729) ; Min: 1.16 MB (1212416) ; Max: 144.00 MB (150994944) ; Number of samples: 116) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.81 GB (1938214151) ; Min: 486.52 MB (510151358) ; Max: 3.68 GB (3953575849) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.59 KB (66145) ; Min: 9.00 B (9) ; Max: 71.01 KB (72715) ; Number of samples: 263722) - AverageHdfsReadThreadConcurrency: 0.57 - AverageScannerThreadConcurrency: 12.60 - BytesRead: 10.35 GB (11109835427) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 1.90K (1897) - CachedFileHandlesMissCount: 7 (7) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 9.93 GB (10667286141) - DataCacheHitCount: 1.84K (1837) - DataCacheMissBytes: 422.05 MB (442549286) - DataCacheMissCount: 67 (67) - DataCachePartialHitCount: 18 (18) - DecompressionTime: 8s855ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 263.72K (263722) - NumRowGroups: 116 (116) - NumRowGroupsWithPageIndex: 116 (116) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.55 GB (1661639718) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 199.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.61 GB (33937414144) - RowBatchQueueGetWaitTime: 87.999ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 18m18s - RowBatchesEnqueued: 534.66K (534657) - RowsRead: 547.31M (547309511) - RowsReturned: 547.23M (547227783) - RowsReturnedRate: 193.78 M/sec - ScanRangesComplete: 604 (604) - ScannerIoWaitTime: 6s015ms - ScannerThreadWorklessLoops: 39 (39) - ScannerThreadsInvoluntaryContextSwitches: 733 (733) - ScannerThreadsTotalWallClockTime: 19m42s - ScannerThreadsSysTime: 15s331ms - ScannerThreadsUserTime: 1m4s - ScannerThreadsVoluntaryContextSwitches: 543.65K (543652) - TotalRawHdfsOpenFileTime(*): 155.999ms - TotalRawHdfsReadTime(*): 53s015ms - TotalReadThroughput: 112.12 MB/sec Buffer pool: - AllocTime: 1s011ms - CumulativeAllocationBytes: 11.30 GB (12133302272) - CumulativeAllocations: 1.81K (1806) - PeakReservation: 1.51 GB (1623195648) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.29 GB (1388314624) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1s011ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1981774) - Rows rejected: 46.39K (46392) - Rows total: 547.31M (547309511) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935382) - Rows rejected: 23.42K (23422) - Rows total: 547.26M (547263119) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.87M (1865354) - Rows rejected: 11.91K (11914) - Rows total: 547.24M (547239697) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.85M (1853440) - Rows rejected: 0 (0) - Rows total: 547.23M (547227783) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 604 (604) - Files rejected: 488 (488) - Files total: 604 (604) - RowGroups processed: 534.42K (534425) - RowGroups rejected: 0 (0) - RowGroups total: 534.42K (534425) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 547.23M (547227783) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) CodeGen:(Total: 927.997ms, non-child: 927.997ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 927.997ms - CodegenSysTime: 0.000ns - CodegenUserTime: 927.940ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 283.999ms - IrGenerationTime: 27.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 599.998ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f00000018 (host=impala-executor-000-7:22000):(Total: 2m39s, non-child: 3.999ms, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:37.307 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/139.10 GB Filter 0 arrival: 932ms Filter 2 arrival: 932ms Filter 8 arrival: 932ms Filter 4 arrival: 1s370ms Filter 6 arrival: 8s023ms Fragment Instance Lifecycle Event Timeline: 2m39s - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 2m39s (2m39s) - First Batch Produced: 2m39s (0.000ns) - First Batch Sent: 2m39s (0.000ns) - ExecInternal Finished: 2m39s (0.000ns) - MemoryUsage (4s000ms): 1.22 GB, 1.61 GB, 1.61 GB, 1.61 GB, 1.64 GB, 1.63 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.63 GB, 1.64 GB, 1.64 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.59 GB, 1.39 GB, 592.86 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB, 256.23 MB - ThreadUsage (4s000ms): 11, 15, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 13, 11, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 8.44 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.64 GB (1762545933) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1783833254) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1s279ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 15s167ms - TotalThreadsInvoluntaryContextSwitches: 1.01K (1009) - TotalThreadsTotalWallClockTime: 22m30s - TotalThreadsSysTime: 32s030ms - TotalThreadsUserTime: 2m51s - TotalThreadsVoluntaryContextSwitches: 579.48K (579475) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m39s - ExecTreeOpenTime: 2m38s - PrepareTime: 3.999ms - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 152.41 KB/sec ; Min: 152.41 KB/sec ; Max: 152.41 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 225.804us ; Min: 124.827us ; Max: 326.782us ; Number of samples: 2) - RpcRecvrTime: (Avg: 30.853us ; Min: 15.729us ; Max: 45.977us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m38s, non-child: 95.999ms, % non-child: 0.06%) Node Lifecycle Event Timeline: 2m39s - Open Started: 923.998ms (923.998ms) - Open Finished: 2m39s (2m38s) - First Batch Requested: 2m39s (0.000ns) - First Batch Returned: 2m39s (0.000ns) - Last Batch Returned: 2m39s (0.000ns) - Closed: 2m39s (0.000ns) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 3.999ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m38s, non-child: 619.997ms, % non-child: 0.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 923.998ms (923.998ms) - Open Finished: 1m34s (1m34s) - First Batch Requested: 1m34s (0.000ns) - First Batch Returned: 1m34s (0.000ns) - Last Batch Returned: 2m39s (1m4s) - Closed: 2m39s (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.27M (6266915) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 607.997ms - RowsReturned: 9.08K (9076) - RowsReturnedRate: 57.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.26M (6264378) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 931.998ms - Open Started: 927.998ms (927.998ms) - Open Finished: 927.998ms (0.000ns) - First Batch Requested: 927.998ms (0.000ns) - First Batch Returned: 927.998ms (0.000ns) - Last Batch Returned: 927.998ms (0.000ns) - Closed: 931.998ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 23.266us ; Min: 18.618us ; Max: 39.873us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m38s, non-child: 171.999ms, % non-child: 0.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 927.998ms (927.998ms) - Open Finished: 1m34s (1m34s) - First Batch Requested: 1m34s (0.000ns) - First Batch Returned: 1m34s (0.000ns) - Last Batch Returned: 2m39s (1m4s) - Closed: 2m39s (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.29M (6286080) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 151.999ms - RowsReturned: 6.27M (6266915) - RowsReturnedRate: 39.61 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.27M (6268415) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 931.998ms - Open Started: 927.998ms (927.998ms) - Open Finished: 927.998ms (0.000ns) - First Batch Requested: 927.998ms (0.000ns) - First Batch Returned: 927.998ms (0.000ns) - Last Batch Returned: 927.998ms (0.000ns) - Closed: 931.998ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 32.073us ; Min: 29.591us ; Max: 34.555us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m38s, non-child: 9s327ms, % non-child: 5.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 927.998ms (927.998ms) - Open Finished: 1m34s (1m34s) - First Batch Requested: 1m34s (0.000ns) - First Batch Returned: 1m34s (0.000ns) - Last Batch Returned: 2m39s (1m4s) - Closed: 2m39s (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 335.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 48.16 MB (50501888) - ProbeRows: 6.33M (6325157) - ProbeRowsPartitioned: 5.89M (5890376) - ProbeTime: 2s087ms - RowsReturned: 6.29M (6286080) - RowsReturnedRate: 39.78 K/sec Buffer pool: - AllocTime: 7.999ms - CumulativeAllocationBytes: 946.00 MB (991952896) - CumulativeAllocations: 457 (457) - PeakReservation: 40.00 MB (41943040) - PeakUnpinnedBytes: 796.00 MB (834666496) - PeakUsedReservation: 40.00 MB (41943040) - ReadIoBytes: 80.00 MB (83886080) - ReadIoOps: 40 (40) - ReadIoWaitTime: 23.999ms - SystemAllocTime: 7.999ms - WriteIoBytes: 796.00 MB (834666496) - WriteIoOps: 398 (398) - WriteIoWaitTime: 587.997ms Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 291.999ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 67.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.21M (8206880) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 151.999ms, non-child: 47.999ms, % non-child: 31.58%) Node Lifecycle Event Timeline: 1s415ms - Open Started: 927.998ms (927.998ms) - Open Finished: 927.998ms (0.000ns) - First Batch Requested: 927.998ms (0.000ns) - First Batch Returned: 927.998ms (0.000ns) - Last Batch Returned: 1s371ms (443.999ms) - Closed: 1s415ms (43.999ms) - ConvertRowBatchTime: 43.999ms - PeakMemoryUsage: 14.29 MB (14979822) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 12.64 M/sec Buffer pool: - AllocTime: 47.999ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 47.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 64.24 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 103.999ms - DataWaitTime: 103.999ms Enqueue: - BytesReceived (500.000ms): 4.77 MB, 4.77 MB, 30.87 MB - DeferredQueueSize (500.000ms): 9, 9, 0 - DispatchTime: (Avg: 30.771us ; Min: 7.087us ; Max: 2.995ms ; Number of samples: 1881) - DeserializeRowBatchTime: 167.999ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 918.303ms - TotalRPCsDeferred: 27 (27) HASH_JOIN_NODE (id=7):(Total: 2m28s, non-child: 2m13s, % non-child: 90.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 927.998ms (927.998ms) - Open Finished: 8s063ms (7s135ms) - First Batch Requested: 8s063ms (0.000ns) - First Batch Returned: 8s091ms (27.999ms) - Last Batch Returned: 2m38s (2m30s) - Closed: 2m39s (1s251ms) - BuildRows: 31.53M (31525830) - BuildTime: 5s635ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 545.24M (545242541) - ProbeRowsPartitioned: 532.44M (532435561) - ProbeTime: 1m46s - RowsReturned: 6.33M (6325157) - RowsReturnedRate: 42.54 K/sec Buffer pool: - AllocTime: 4s279ms - CumulativeAllocationBytes: 70.57 GB (75778490368) - CumulativeAllocations: 35.64K (35638) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 38.64 GB (41494249472) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 30.93 GB (33210499072) - ReadIoOps: 15.84K (15836) - ReadIoWaitTime: 15s319ms - SystemAllocTime: 4s247ms - WriteIoBytes: 38.64 GB (41494249472) - WriteIoOps: 19.79K (19786) - WriteIoWaitTime: 28s395ms Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5s587ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 1s959ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 563.96M (563961391) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 1s487ms, non-child: 371.999ms, % non-child: 25.00%) Node Lifecycle Event Timeline: 8s063ms - Open Started: 927.998ms (927.998ms) - Open Finished: 927.998ms (0.000ns) - First Batch Requested: 931.998ms (3.999ms) - First Batch Returned: 931.998ms (0.000ns) - Last Batch Returned: 8s023ms (7s091ms) - Closed: 8s063ms (39.999ms) - ConvertRowBatchTime: 303.999ms - PeakMemoryUsage: 13.15 MB (13789182) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 21.19 M/sec Buffer pool: - AllocTime: 87.999ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 75.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 52.69 MB, 159.98 MB, 275.64 MB, 400.31 MB, 522.36 MB, 639.00 MB, 768.86 MB, 895.45 MB, 1011.16 MB, 1.11 GB, 1.24 GB, 1.35 GB, 1.47 GB, 1.58 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 1s167ms - DataWaitTime: 1s115ms Enqueue: - BytesReceived (500.000ms): 4.67 MB, 4.67 MB, 25.94 MB, 71.50 MB, 123.24 MB, 178.94 MB, 234.22 MB, 288.40 MB, 343.64 MB, 400.24 MB, 455.23 MB, 509.26 MB, 565.28 MB, 622.00 MB, 675.32 MB, 724.60 MB - DeferredQueueSize (500.000ms): 9, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 18.542us ; Min: 5.055us ; Max: 6.237ms ; Number of samples: 30799) - DeserializeRowBatchTime: 1s535ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 898.189ms - TotalRPCsDeferred: 40 (40) HASH_JOIN_NODE (id=6):(Total: 13s399ms, non-child: 10s447ms, % non-child: 77.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 927.998ms (927.998ms) - Open Finished: 1s099ms (171.999ms) - First Batch Requested: 8s063ms (6s963ms) - First Batch Returned: 8s063ms (0.000ns) - Last Batch Returned: 1m34s (1m26s) - Closed: 2m39s (1m5s) - BuildRows: 365 (365) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 545.24M (545242541) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s219ms - RowsReturned: 545.24M (545242541) - RowsReturnedRate: 40.69 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 545.24M (545242906) - Resizes: 0 (0) - Travel: 177.93M (177934630) EXCHANGE_NODE (id=12): Node Lifecycle Event Timeline: 931.998ms - Open Started: 927.998ms (927.998ms) - Open Finished: 927.998ms (0.000ns) - First Batch Requested: 931.998ms (3.999ms) - First Batch Returned: 931.998ms (0.000ns) - Last Batch Returned: 931.998ms (0.000ns) - Closed: 931.998ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 31.632us ; Min: 31.632us ; Max: 31.632us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s951ms, non-child: 2s951ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/139.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Not all filters arrived (arrived: [0, 2, 8], missing [4, 6]), waited for 68ms. Arrival delay: 1s000ms. Hdfs Read Thread Concurrency Bucket: 0:72.87% 1:9.574% 2:8.511% 3:6.383% 4:0.5319% 5:0% 6:0.5319% 7:0% 8:1.596% File Formats: PARQUET/SNAPPY:116 PARQUET/Unknown(Skipped):482 Node Lifecycle Event Timeline: 2m39s - Open Started: 927.998ms (927.998ms) - Open Finished: 927.998ms (0.000ns) - First Batch Requested: 931.998ms (3.999ms) - First Batch Returned: 1s099ms (167.999ms) - Last Batch Returned: 1m34s (1m33s) - Closed: 2m39s (1m5s) - BytesRead (2s000ms): 553.96 MB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.17 GB, 1.18 GB, 1.36 GB, 1.79 GB, 2.30 GB, 2.31 GB, 2.46 GB, 2.99 GB, 3.46 GB, 3.60 GB, 4.23 GB, 4.56 GB, 4.78 GB, 5.28 GB, 5.75 GB, 5.97 GB, 6.45 GB, 6.95 GB, 7.15 GB, 7.47 GB, 7.93 GB, 8.23 GB, 8.36 GB, 8.43 GB, 8.53 GB, 8.85 GB, 8.97 GB, 9.07 GB, 9.20 GB, 9.20 GB, 9.29 GB, 9.42 GB, 9.62 GB, 9.77 GB, 9.81 GB, 10.17 GB, 10.31 GB, 10.31 GB, 10.31 GB, 10.32 GB, 10.32 GB - FooterProcessingTime: (Avg: 310.344us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 116) - InitialRangeActualReservation: (Avg: 111.00 MB (116391936) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 116) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 116) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1215767100) ; Min: 471.81 MB (494725088) ; Max: 2.00 GB (2149880961) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.67 KB (41641) ; Min: 11.00 B (11) ; Max: 69.81 KB (71488) ; Number of samples: 262767) - ParquetRowGroupActualReservation: (Avg: 119.83 MB (125648331) ; Min: 48.00 MB (50331648) ; Max: 136.00 MB (142606336) ; Number of samples: 116) - ParquetRowGroupIdealReservation: (Avg: 119.23 MB (125018394) ; Min: 2.31 MB (2424832) ; Max: 144.00 MB (150994944) ; Number of samples: 116) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1931631788) ; Min: 484.75 MB (508297969) ; Max: 3.67 GB (3940258909) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.61 KB (66160) ; Min: 9.00 B (9) ; Max: 70.85 KB (72553) ; Number of samples: 262767) - AverageHdfsReadThreadConcurrency: 0.66 - AverageScannerThreadConcurrency: 12.58 - BytesRead: 10.32 GB (11076674890) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 1.96K (1958) - CachedFileHandlesMissCount: 4 (4) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 9.89 GB (10619344841) - DataCacheHitCount: 1.83K (1835) - DataCacheMissBytes: 436.14 MB (457330049) - DataCacheMissCount: 127 (127) - DataCachePartialHitCount: 81 (81) - DecompressionTime: 8s543ms - MaterializeTupleTime(*): 1m - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 262.77K (262767) - NumRowGroups: 116 (116) - NumRowGroupsWithPageIndex: 116 (116) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 GB (1657513163) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 168.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.49 GB (33814374400) - RowBatchQueueGetWaitTime: 95.999ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 18m14s - RowBatchesEnqueued: 532.72K (532719) - RowsRead: 545.32M (545323618) - RowsReturned: 545.24M (545242541) - RowsReturnedRate: 184.70 M/sec - ScanRangesComplete: 598 (598) - ScannerIoWaitTime: 15s167ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 643 (643) - ScannerThreadsTotalWallClockTime: 19m43s - ScannerThreadsSysTime: 14s752ms - ScannerThreadsUserTime: 1m2s - ScannerThreadsVoluntaryContextSwitches: 541.30K (541296) - TotalRawHdfsOpenFileTime(*): 1s139ms - TotalRawHdfsReadTime(*): 1m2s - TotalReadThroughput: 111.20 MB/sec Buffer pool: - AllocTime: 1s187ms - CumulativeAllocationBytes: 11.29 GB (12118474752) - CumulativeAllocations: 1.80K (1803) - PeakReservation: 1.51 GB (1619001344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.30 GB (1392574464) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1s183ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1981233) - Rows rejected: 46.17K (46172) - Rows total: 545.32M (545323618) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935061) - Rows rejected: 23.49K (23488) - Rows total: 545.28M (545277446) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.85M (1851545) - Rows rejected: 11.42K (11417) - Rows total: 545.25M (545253958) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.84M (1837056) - Rows rejected: 0 (0) - Rows total: 545.24M (545242541) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 598 (598) - Files rejected: 482 (482) - Files total: 598 (598) - RowGroups processed: 532.49K (532487) - RowGroups rejected: 0 (0) - RowGroups total: 532.49K (532487) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 545.24M (545242541) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) CodeGen:(Total: 919.998ms, non-child: 919.998ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 919.998ms - CodegenSysTime: 3.983ms - CodegenUserTime: 915.984ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 279.999ms - IrGenerationTime: 31.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 595.998ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f00000020 (host=impala-executor-000-3:22000):(Total: 2m39s, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:36.931 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/138.94 GB Filter 0 arrival: 921ms Filter 2 arrival: 921ms Filter 8 arrival: 922ms Filter 4 arrival: 1s370ms Filter 6 arrival: 8s022ms Fragment Instance Lifecycle Event Timeline: 2m39s - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 2m39s (2m39s) - First Batch Produced: 2m39s (0.000ns) - First Batch Sent: 2m39s (0.000ns) - ExecInternal Finished: 2m39s (0.000ns) - MemoryUsage (4s000ms): 1.23 GB, 1.62 GB, 1.62 GB, 1.62 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.63 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.63 GB, 1.51 GB, 1.30 GB, 616.24 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB, 258.23 MB - ThreadUsage (4s000ms): 11, 15, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 11, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 8.47 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.64 GB (1764178758) - PeakReservation: 1.60 GB (1717370880) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1781773442) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1s891ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 6s639ms - TotalThreadsInvoluntaryContextSwitches: 943 (943) - TotalThreadsTotalWallClockTime: 22m33s - TotalThreadsSysTime: 31s245ms - TotalThreadsUserTime: 2m51s - TotalThreadsVoluntaryContextSwitches: 589.44K (589436) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m39s - ExecTreeOpenTime: 2m38s - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 146.57 KB/sec ; Min: 146.57 KB/sec ; Max: 146.57 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 221.884us ; Min: 117.282us ; Max: 326.486us ; Number of samples: 2) - RpcRecvrTime: (Avg: 32.917us ; Min: 16.969us ; Max: 48.866us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 49.00 B (49) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m38s, non-child: 35.999ms, % non-child: 0.02%) Node Lifecycle Event Timeline: 2m39s - Open Started: 915.998ms (915.998ms) - Open Finished: 2m39s (2m38s) - First Batch Requested: 2m39s (0.000ns) - First Batch Returned: 2m39s (0.000ns) - Last Batch Returned: 2m39s (0.000ns) - Closed: 2m39s (0.000ns) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 3.999ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m38s, non-child: 615.999ms, % non-child: 0.39%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 915.998ms (915.998ms) - Open Finished: 1m35s (1m34s) - First Batch Requested: 1m35s (0.000ns) - First Batch Returned: 1m35s (0.000ns) - Last Batch Returned: 2m39s (1m4s) - Closed: 2m39s (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 7.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.35M (6350550) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 599.999ms - RowsReturned: 8.71K (8706) - RowsReturnedRate: 54.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 3.999ms - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.35M (6348421) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 923.998ms - Open Started: 915.998ms (915.998ms) - Open Finished: 915.998ms (0.000ns) - First Batch Requested: 915.998ms (0.000ns) - First Batch Returned: 915.998ms (0.000ns) - Last Batch Returned: 919.998ms (3.999ms) - Closed: 923.998ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 17.387us ; Min: 14.101us ; Max: 24.799us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m37s, non-child: 155.999ms, % non-child: 0.10%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 915.998ms (915.998ms) - Open Finished: 1m35s (1m34s) - First Batch Requested: 1m35s (0.000ns) - First Batch Returned: 1m35s (0.000ns) - Last Batch Returned: 2m39s (1m4s) - Closed: 2m39s (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 7.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.37M (6370268) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 143.999ms - RowsReturned: 6.35M (6350550) - RowsReturnedRate: 40.22 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.35M (6352050) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 923.998ms - Open Started: 915.998ms (915.998ms) - Open Finished: 915.998ms (0.000ns) - First Batch Requested: 919.998ms (3.999ms) - First Batch Returned: 919.998ms (0.000ns) - Last Batch Returned: 919.998ms (0.000ns) - Closed: 923.998ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 37.302us ; Min: 32.256us ; Max: 42.349us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m37s, non-child: 8s723ms, % non-child: 5.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 915.998ms (915.998ms) - Open Finished: 1m35s (1m34s) - First Batch Requested: 1m35s (0.000ns) - First Batch Returned: 1m35s (0.000ns) - Last Batch Returned: 2m39s (1m4s) - Closed: 2m39s (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 339.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 50.16 MB (52599040) - ProbeRows: 6.41M (6407127) - ProbeRowsPartitioned: 5.97M (5972317) - ProbeTime: 1s527ms - RowsReturned: 6.37M (6370268) - RowsReturnedRate: 40.38 K/sec Buffer pool: - AllocTime: 19.999ms - CumulativeAllocationBytes: 956.00 MB (1002438656) - CumulativeAllocations: 462 (462) - PeakReservation: 42.00 MB (44040192) - PeakUnpinnedBytes: 808.00 MB (847249408) - PeakUsedReservation: 42.00 MB (44040192) - ReadIoBytes: 78.00 MB (81788928) - ReadIoOps: 39 (39) - ReadIoWaitTime: 19.999ms - SystemAllocTime: 15.999ms - WriteIoBytes: 808.00 MB (847249408) - WriteIoOps: 404 (404) - WriteIoWaitTime: 119.999ms Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 295.999ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 79.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.29M (8291068) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 155.999ms, non-child: 7.999ms, % non-child: 5.13%) Node Lifecycle Event Timeline: 1s411ms - Open Started: 915.998ms (915.998ms) - Open Finished: 915.998ms (0.000ns) - First Batch Requested: 919.998ms (3.999ms) - First Batch Returned: 919.998ms (0.000ns) - Last Batch Returned: 1s371ms (451.999ms) - Closed: 1s411ms (39.999ms) - ConvertRowBatchTime: 3.999ms - PeakMemoryUsage: 14.26 MB (14955530) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 12.31 M/sec Buffer pool: - AllocTime: 39.999ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 39.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 76.03 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 151.999ms - DataWaitTime: 147.999ms Enqueue: - BytesReceived (500.000ms): 4.77 MB, 4.77 MB, 38.23 MB - DeferredQueueSize (500.000ms): 9, 9, 0 - DispatchTime: (Avg: 26.766us ; Min: 6.227us ; Max: 4.277ms ; Number of samples: 1881) - DeserializeRowBatchTime: 151.999ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 899.927ms - TotalRPCsDeferred: 22 (22) HASH_JOIN_NODE (id=7):(Total: 2m29s, non-child: 2m13s, % non-child: 89.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 915.998ms (915.998ms) - Open Finished: 8s067ms (7s151ms) - First Batch Requested: 8s067ms (0.000ns) - First Batch Returned: 8s095ms (27.999ms) - Last Batch Returned: 2m38s (2m30s) - Closed: 2m39s (1s247ms) - BuildRows: 31.53M (31525830) - BuildTime: 5s127ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 550.85M (550848422) - ProbeRowsPartitioned: 537.91M (537913080) - ProbeTime: 1m46s - RowsReturned: 6.41M (6407127) - RowsReturnedRate: 43.00 K/sec Buffer pool: - AllocTime: 3s979ms - CumulativeAllocationBytes: 71.33 GB (76592185344) - CumulativeAllocations: 36.03K (36026) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 39.03 GB (41903194112) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 31.31 GB (33615249408) - ReadIoOps: 16.03K (16029) - ReadIoWaitTime: 15s239ms - SystemAllocTime: 3s935ms - WriteIoBytes: 39.03 GB (41903194112) - WriteIoOps: 19.98K (19981) - WriteIoWaitTime: 28s483ms Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5s071ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 1s979ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 569.44M (569438910) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 2s011ms, non-child: 315.999ms, % non-child: 15.71%) Node Lifecycle Event Timeline: 8s067ms - Open Started: 915.998ms (915.998ms) - Open Finished: 915.998ms (0.000ns) - First Batch Requested: 923.998ms (7.999ms) - First Batch Returned: 923.998ms (0.000ns) - Last Batch Returned: 8s023ms (7s099ms) - Closed: 8s067ms (43.999ms) - ConvertRowBatchTime: 263.999ms - PeakMemoryUsage: 13.15 MB (13788904) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 15.67 M/sec Buffer pool: - AllocTime: 79.999ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 12.98 MB (13606912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.98 MB (13606912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 51.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 65.75 MB, 169.33 MB, 288.54 MB, 410.80 MB, 533.35 MB, 652.33 MB, 782.03 MB, 897.09 MB, 1.00 GB, 1.13 GB, 1.24 GB, 1.36 GB, 1.49 GB, 1.59 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 1s731ms - DataWaitTime: 1s695ms Enqueue: - BytesReceived (500.000ms): 4.64 MB, 4.64 MB, 30.12 MB, 75.68 MB, 128.99 MB, 184.90 MB, 238.37 MB, 291.58 MB, 349.52 MB, 405.20 MB, 458.16 MB, 515.03 MB, 571.07 MB, 623.78 MB, 680.26 MB, 729.26 MB - DeferredQueueSize (500.000ms): 8, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 17.841us ; Min: 5.450us ; Max: 3.840ms ; Number of samples: 30799) - DeserializeRowBatchTime: 1s483ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 893.442ms - TotalRPCsDeferred: 47 (47) HASH_JOIN_NODE (id=6):(Total: 13s455ms, non-child: 10s455ms, % non-child: 77.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 915.998ms (915.998ms) - Open Finished: 1s083ms (167.999ms) - First Batch Requested: 8s067ms (6s983ms) - First Batch Returned: 8s067ms (0.000ns) - Last Batch Returned: 1m34s (1m26s) - Closed: 2m39s (1m4s) - BuildRows: 365 (365) - BuildTime: 7.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 550.85M (550848422) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s227ms - RowsReturned: 550.85M (550848422) - RowsReturnedRate: 40.94 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 550.85M (550848787) - Resizes: 0 (0) - Travel: 184.82M (184819129) EXCHANGE_NODE (id=12): Node Lifecycle Event Timeline: 923.998ms - Open Started: 915.998ms (915.998ms) - Open Finished: 915.998ms (0.000ns) - First Batch Requested: 923.998ms (7.999ms) - First Batch Returned: 923.998ms (0.000ns) - Last Batch Returned: 923.998ms (0.000ns) - Closed: 923.998ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 19.215us ; Min: 19.215us ; Max: 19.215us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s999ms, non-child: 2s999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/138.94 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: Not all filters arrived (arrived: [0, 2, 8], missing [4, 6]), waited for 78ms. Arrival delay: 1s000ms. Hdfs Read Thread Concurrency Bucket: 0:78.07% 1:10.7% 2:4.278% 3:3.743% 4:1.07% 5:1.07% 6:0% 7:1.07% 8:0% File Formats: PARQUET/SNAPPY:118 PARQUET/Unknown(Skipped):480 Node Lifecycle Event Timeline: 2m39s - Open Started: 915.998ms (915.998ms) - Open Finished: 915.998ms (0.000ns) - First Batch Requested: 923.998ms (7.999ms) - First Batch Returned: 1s083ms (159.999ms) - Last Batch Returned: 1m34s (1m33s) - Closed: 2m39s (1m4s) - BytesRead (2s000ms): 559.14 MB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.13 GB, 1.16 GB, 1.18 GB, 1.37 GB, 1.96 GB, 2.31 GB, 2.32 GB, 2.53 GB, 3.14 GB, 3.54 GB, 3.73 GB, 4.23 GB, 4.70 GB, 4.84 GB, 5.37 GB, 5.86 GB, 6.01 GB, 6.47 GB, 6.98 GB, 7.17 GB, 7.71 GB, 8.03 GB, 8.31 GB, 8.54 GB, 8.74 GB, 8.92 GB, 9.10 GB, 9.15 GB, 9.24 GB, 9.29 GB, 9.31 GB, 9.59 GB, 9.69 GB, 9.74 GB, 9.86 GB, 9.99 GB, 10.32 GB, 10.40 GB, 10.40 GB, 10.40 GB, 10.42 GB, 10.42 GB - FooterProcessingTime: (Avg: 508.473us ; Min: 0.000ns ; Max: 23.999ms ; Number of samples: 118) - InitialRangeActualReservation: (Avg: 109.80 MB (115130090) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 118) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 118) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.14 GB (1228050458) ; Min: 476.67 MB (499829041) ; Max: 2.02 GB (2171710149) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.68 KB (41655) ; Min: 11.00 B (11) ; Max: 70.03 KB (71709) ; Number of samples: 265332) - ParquetRowGroupActualReservation: (Avg: 118.47 MB (124229597) ; Min: 64.00 MB (67108864) ; Max: 136.00 MB (142606336) ; Number of samples: 118) - ParquetRowGroupIdealReservation: (Avg: 118.41 MB (124158507) ; Min: 88.00 MB (92274688) ; Max: 136.00 MB (142606336) ; Number of samples: 118) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.82 GB (1950353575) ; Min: 489.76 MB (513548196) ; Max: 3.70 GB (3975706732) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.60 KB (66155) ; Min: 9.00 B (9) ; Max: 70.85 KB (72550) ; Number of samples: 265332) - AverageHdfsReadThreadConcurrency: 0.48 - AverageScannerThreadConcurrency: 12.66 - BytesRead: 10.42 GB (11189914963) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 1.91K (1906) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.14 GB (10891281345) - DataCacheHitCount: 1.86K (1864) - DataCacheMissBytes: 284.80 MB (298633618) - DataCacheMissCount: 48 (48) - DataCachePartialHitCount: 18 (18) - DecompressionTime: 9s091ms - MaterializeTupleTime(*): 1m1s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 265.33K (265332) - NumRowGroups: 118 (118) - NumRowGroupsWithPageIndex: 118 (118) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 GB (1657048370) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 243.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.82 GB (34161852416) - RowBatchQueueGetWaitTime: 79.999ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 18m22s - RowBatchesEnqueued: 538.19K (538194) - RowsRead: 550.93M (550932018) - RowsReturned: 550.85M (550848422) - RowsReturnedRate: 183.62 M/sec - ScanRangesComplete: 598 (598) - ScannerIoWaitTime: 6s639ms - ScannerThreadWorklessLoops: 39 (39) - ScannerThreadsInvoluntaryContextSwitches: 595 (595) - ScannerThreadsTotalWallClockTime: 19m46s - ScannerThreadsSysTime: 14s664ms - ScannerThreadsUserTime: 1m3s - ScannerThreadsVoluntaryContextSwitches: 547.29K (547287) - TotalRawHdfsOpenFileTime(*): 115.999ms - TotalRawHdfsReadTime(*): 43s815ms - TotalReadThroughput: 112.93 MB/sec Buffer pool: - AllocTime: 931.998ms - CumulativeAllocationBytes: 11.50 GB (12342788096) - CumulativeAllocations: 1.83K (1828) - PeakReservation: 1.51 GB (1619001344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.29 GB (1390411776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 931.998ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2016632) - Rows rejected: 47.80K (47805) - Rows total: 550.93M (550932018) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1968827) - Rows rejected: 23.84K (23835) - Rows total: 550.88M (550884213) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.92M (1915572) - Rows rejected: 11.96K (11956) - Rows total: 550.86M (550860378) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.90M (1902592) - Rows rejected: 0 (0) - Rows total: 550.85M (550848422) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 598 (598) - Files rejected: 480 (480) - Files total: 598 (598) - RowGroups processed: 537.96K (537958) - RowGroups rejected: 0 (0) - RowGroups total: 537.96K (537958) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 550.85M (550848422) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) CodeGen:(Total: 911.998ms, non-child: 911.998ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 911.998ms - CodegenSysTime: 7.907ms - CodegenUserTime: 904.079ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 279.999ms - IrGenerationTime: 27.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 587.999ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f00000017 (host=impala-executor-000-6:22000):(Total: 2m39s, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:36.578 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:596/139.02 GB Filter 0 arrival: 952ms Filter 2 arrival: 952ms Filter 8 arrival: 952ms Filter 4 arrival: 1s370ms Filter 6 arrival: 8s021ms Fragment Instance Lifecycle Event Timeline: 2m39s - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 2m39s (2m39s) - First Batch Produced: 2m39s (0.000ns) - First Batch Sent: 2m39s (0.000ns) - ExecInternal Finished: 2m39s (0.000ns) - MemoryUsage (4s000ms): 1.24 GB, 1.62 GB, 1.62 GB, 1.62 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.36 GB, 465.30 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB, 252.18 MB - ThreadUsage (4s000ms): 11, 15, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 11, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 8.48 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.64 GB (1760632465) - PeakReservation: 1.60 GB (1713176576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1784251102) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 563.999ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 9s199ms - TotalThreadsInvoluntaryContextSwitches: 980 (980) - TotalThreadsTotalWallClockTime: 22m31s - TotalThreadsSysTime: 32s413ms - TotalThreadsUserTime: 2m55s - TotalThreadsVoluntaryContextSwitches: 570.02K (570021) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m39s - ExecTreeOpenTime: 2m38s - PrepareTime: 3.999ms - ExecTreePrepareTime: 3.999ms KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 116.14 KB/sec ; Min: 116.14 KB/sec ; Max: 116.14 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 253.651us ; Min: 112.114us ; Max: 395.188us ; Number of samples: 2) - RpcRecvrTime: (Avg: 35.674us ; Min: 16.615us ; Max: 54.734us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 47.00 B (47) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m38s, non-child: 3.999ms, % non-child: 0.00%) Node Lifecycle Event Timeline: 2m39s - Open Started: 947.994ms (947.994ms) - Open Finished: 2m39s (2m38s) - First Batch Requested: 2m39s (0.000ns) - First Batch Returned: 2m39s (0.000ns) - Last Batch Returned: 2m39s (0.000ns) - Closed: 2m39s (0.000ns) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m38s, non-child: 563.996ms, % non-child: 0.36%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 947.994ms (947.994ms) - Open Finished: 2m37s (2m36s) - First Batch Requested: 2m37s (0.000ns) - First Batch Returned: 2m37s (3.999ms) - Last Batch Returned: 2m39s (1s419ms) - Closed: 2m39s (3.999ms) - BuildRows: 7.20K (7200) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.28M (6281495) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 559.996ms - RowsReturned: 8.85K (8845) - RowsReturnedRate: 55.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.28M (6279019) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 951.994ms - Open Started: 947.994ms (947.994ms) - Open Finished: 947.994ms (0.000ns) - First Batch Requested: 947.994ms (0.000ns) - First Batch Returned: 947.994ms (0.000ns) - Last Batch Returned: 947.994ms (0.000ns) - Closed: 951.994ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 17.666us ; Min: 12.721us ; Max: 29.159us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m37s, non-child: 179.999ms, % non-child: 0.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 947.994ms (947.994ms) - Open Finished: 2m37s (2m36s) - First Batch Requested: 2m37s (0.000ns) - First Batch Returned: 2m37s (0.000ns) - Last Batch Returned: 2m39s (1s423ms) - Closed: 2m39s (3.999ms) - BuildRows: 1.50K (1500) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.30M (6301387) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 131.999ms - RowsReturned: 6.28M (6281495) - RowsReturnedRate: 39.86 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.28M (6282995) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 951.994ms - Open Started: 947.994ms (947.994ms) - Open Finished: 947.994ms (0.000ns) - First Batch Requested: 947.994ms (0.000ns) - First Batch Returned: 947.994ms (0.000ns) - Last Batch Returned: 947.994ms (0.000ns) - Closed: 951.994ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 31.623us ; Min: 26.441us ; Max: 36.806us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m37s, non-child: 9s091ms, % non-child: 5.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 947.994ms (947.994ms) - Open Finished: 1m33s (1m32s) - First Batch Requested: 1m33s (0.000ns) - First Batch Returned: 1m33s (0.000ns) - Last Batch Returned: 2m39s (1m5s) - Closed: 2m39s (3.999ms) - BuildRows: 1.92M (1920800) - BuildTime: 379.997ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 44.22 MB (46371072) - ProbeRows: 6.34M (6340355) - ProbeRowsPartitioned: 6.30M (6301387) - ProbeTime: 1s699ms - RowsReturned: 6.30M (6301387) - RowsReturnedRate: 40.03 K/sec Buffer pool: - AllocTime: 35.999ms - CumulativeAllocationBytes: 1012.00 MB (1061158912) - CumulativeAllocations: 490 (490) - PeakReservation: 36.00 MB (37748736) - PeakUnpinnedBytes: 852.00 MB (893386752) - PeakUsedReservation: 36.00 MB (37748736) - ReadIoBytes: 96.00 MB (100663296) - ReadIoOps: 48 (48) - ReadIoWaitTime: 15.999ms - SystemAllocTime: 35.999ms - WriteIoBytes: 852.00 MB (893386752) - WriteIoOps: 426 (426) - WriteIoWaitTime: 47.999ms Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 331.998ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 83.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.22M (8222187) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 87.999ms, non-child: 23.999ms, % non-child: 27.27%) Node Lifecycle Event Timeline: 1s419ms - Open Started: 947.994ms (947.994ms) - Open Finished: 947.994ms (0.000ns) - First Batch Requested: 947.994ms (0.000ns) - First Batch Returned: 947.994ms (0.000ns) - Last Batch Returned: 1s371ms (423.997ms) - Closed: 1s419ms (47.999ms) - ConvertRowBatchTime: 23.999ms - PeakMemoryUsage: 14.29 MB (14979906) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 21.83 M/sec Buffer pool: - AllocTime: 7.999ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.09 MB (14778368) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.09 MB (14778368) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 6.25 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 63.999ms - DataWaitTime: 63.999ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 4.93 MB - DeferredQueueSize (500.000ms): 10, 0 - DispatchTime: (Avg: 27.013us ; Min: 7.048us ; Max: 1.831ms ; Number of samples: 1881) - DeserializeRowBatchTime: 111.999ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 994.274ms - TotalRPCsDeferred: 246 (246) HASH_JOIN_NODE (id=7):(Total: 2m28s, non-child: 2m13s, % non-child: 89.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 947.994ms (947.994ms) - Open Finished: 8s063ms (7s115ms) - First Batch Requested: 8s063ms (0.000ns) - First Batch Returned: 8s091ms (28.000ms) - Last Batch Returned: 2m37s (2m29s) - Closed: 2m39s (1s447ms) - BuildRows: 31.53M (31525830) - BuildTime: 6s223ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 544.32M (544322643) - ProbeRowsPartitioned: 531.57M (531571047) - ProbeTime: 1m45s - RowsReturned: 6.34M (6340355) - RowsReturnedRate: 42.74 K/sec Buffer pool: - AllocTime: 4s419ms - CumulativeAllocationBytes: 70.44 GB (75633786880) - CumulativeAllocations: 35.57K (35569) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 38.59 GB (41431334912) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 30.85 GB (33128710144) - ReadIoOps: 15.80K (15797) - ReadIoWaitTime: 15s675ms - SystemAllocTime: 4s407ms - WriteIoBytes: 38.59 GB (41431334912) - WriteIoOps: 19.76K (19756) - WriteIoWaitTime: 26s055ms Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 6s175ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 1s875ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 563.10M (563096877) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 871.998ms, non-child: 427.999ms, % non-child: 49.08%) Node Lifecycle Event Timeline: 8s063ms - Open Started: 947.994ms (947.994ms) - Open Finished: 947.994ms (0.000ns) - First Batch Requested: 951.994ms (3.999ms) - First Batch Returned: 951.994ms (0.000ns) - Last Batch Returned: 8s023ms (7s071ms) - Closed: 8s063ms (40.000ms) - ConvertRowBatchTime: 363.999ms - PeakMemoryUsage: 13.15 MB (13789406) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 36.15 M/sec Buffer pool: - AllocTime: 43.999ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 12.98 MB (13606912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.98 MB (13606912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 11.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 2.95 MB, 103.47 MB, 215.19 MB, 335.70 MB, 448.35 MB, 571.61 MB, 696.12 MB, 821.44 MB, 948.57 MB, 1.05 GB, 1.17 GB, 1.29 GB, 1.41 GB, 1.53 GB, 1.64 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 491.999ms - DataWaitTime: 443.999ms Enqueue: - BytesReceived (500.000ms): 4.62 MB, 4.71 MB, 46.27 MB, 96.40 MB, 150.51 MB, 205.01 MB, 257.89 MB, 314.08 MB, 371.66 MB, 423.96 MB, 480.63 MB, 537.31 MB, 589.66 MB, 646.99 MB, 699.78 MB, 748.50 MB - DeferredQueueSize (500.000ms): 7, 0, 0, 0, 0, 7, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 18.921us ; Min: 5.448us ; Max: 3.234ms ; Number of samples: 30799) - DeserializeRowBatchTime: 1s363ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 1s278ms - TotalRPCsDeferred: 269 (269) HASH_JOIN_NODE (id=6):(Total: 14s015ms, non-child: 11s163ms, % non-child: 79.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m39s - Open Started: 947.994ms (947.994ms) - Open Finished: 1s075ms (127.999ms) - First Batch Requested: 8s063ms (6s987ms) - First Batch Returned: 8s063ms (0.000ns) - Last Batch Returned: 1m33s (1m25s) - Closed: 2m39s (1m5s) - BuildRows: 365 (365) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 544.32M (544322643) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s927ms - RowsReturned: 544.32M (544322643) - RowsReturnedRate: 38.84 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 544.32M (544323008) - Resizes: 0 (0) - Travel: 173.74M (173743299) EXCHANGE_NODE (id=12): Node Lifecycle Event Timeline: 951.994ms - Open Started: 947.994ms (947.994ms) - Open Finished: 947.994ms (0.000ns) - First Batch Requested: 951.994ms (3.999ms) - First Batch Returned: 951.994ms (0.000ns) - Last Batch Returned: 951.994ms (0.000ns) - Closed: 951.994ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB - DeferredQueueSize (500.000ms): 0 - DispatchTime: (Avg: 34.246us ; Min: 34.246us ; Max: 34.246us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s851ms, non-child: 2s851ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:596/139.02 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: Not all filters arrived (arrived: [0, 2, 8], missing [4, 6]), waited for 49ms. Arrival delay: 1s001ms. Hdfs Read Thread Concurrency Bucket: 0:73.66% 1:8.065% 2:4.301% 3:5.376% 4:2.688% 5:3.226% 6:1.075% 7:0% 8:1.613% File Formats: PARQUET/SNAPPY:115 PARQUET/Unknown(Skipped):481 Node Lifecycle Event Timeline: 2m39s - Open Started: 947.994ms (947.994ms) - Open Finished: 947.994ms (0.000ns) - First Batch Requested: 951.994ms (3.999ms) - First Batch Returned: 1s075ms (123.999ms) - Last Batch Returned: 1m33s (1m32s) - Closed: 2m39s (1m5s) - BytesRead (2s000ms): 534.40 MB, 1.14 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.15 GB, 1.17 GB, 1.24 GB, 1.34 GB, 1.79 GB, 2.36 GB, 2.39 GB, 2.45 GB, 2.89 GB, 3.54 GB, 3.59 GB, 3.93 GB, 4.63 GB, 4.78 GB, 5.07 GB, 5.69 GB, 5.93 GB, 6.17 GB, 6.75 GB, 7.09 GB, 7.33 GB, 7.86 GB, 8.28 GB, 8.43 GB, 8.75 GB, 8.85 GB, 9.04 GB, 9.07 GB, 9.13 GB, 9.34 GB, 9.44 GB, 9.53 GB, 9.55 GB, 9.70 GB, 9.98 GB, 10.07 GB, 10.07 GB, 10.25 GB, 10.27 GB, 10.28 GB, 10.29 GB - FooterProcessingTime: (Avg: 452.171us ; Min: 0.000ns ; Max: 15.999ms ; Number of samples: 115) - InitialRangeActualReservation: (Avg: 109.36 MB (114668624) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 115) - InitialRangeIdealReservation: (Avg: 127.17 KB (130217) ; Min: 32.00 KB (32768) ; Max: 128.00 KB (131072) ; Number of samples: 115) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1213031657) ; Min: 471.01 MB (493890952) ; Max: 2.00 GB (2146371695) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.61 KB (41588) ; Min: 11.00 B (11) ; Max: 69.82 KB (71499) ; Number of samples: 262507) - ParquetRowGroupActualReservation: (Avg: 118.26 MB (124005509) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 115) - ParquetRowGroupIdealReservation: (Avg: 120.60 MB (126460616) ; Min: 72.00 KB (73728) ; Max: 144.00 MB (150994944) ; Number of samples: 115) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1929301361) ; Min: 483.92 MB (507428402) ; Max: 3.67 GB (3938598103) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.59 KB (66145) ; Min: 9.00 B (9) ; Max: 70.67 KB (72368) ; Number of samples: 262507) - AverageHdfsReadThreadConcurrency: 0.85 - AverageScannerThreadConcurrency: 12.71 - BytesRead: 10.29 GB (11049700870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 1.90K (1895) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 9.73 GB (10449017249) - DataCacheHitCount: 1.81K (1813) - DataCacheMissBytes: 572.86 MB (600683621) - DataCacheMissCount: 88 (88) - DataCachePartialHitCount: 22 (22) - DecompressionTime: 8s767ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 262.51K (262507) - NumRowGroups: 115 (115) - NumRowGroupsWithPageIndex: 115 (115) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 GB (1657688517) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 135.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.44 GB (33757231104) - RowBatchQueueGetWaitTime: 71.999ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 18m18s - RowBatchesEnqueued: 531.82K (531819) - RowsRead: 544.40M (544402237) - RowsReturned: 544.32M (544322643) - RowsReturnedRate: 190.86 M/sec - ScanRangesComplete: 596 (596) - ScannerIoWaitTime: 9s199ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 642 (642) - ScannerThreadsTotalWallClockTime: 19m45s - ScannerThreadsSysTime: 15s020ms - ScannerThreadsUserTime: 1m5s - ScannerThreadsVoluntaryContextSwitches: 541.00K (540999) - TotalRawHdfsOpenFileTime(*): 127.999ms - TotalRawHdfsReadTime(*): 1m17s - TotalReadThroughput: 112.70 MB/sec Buffer pool: - AllocTime: 935.994ms - CumulativeAllocationBytes: 11.17 GB (11988910080) - CumulativeAllocations: 1.78K (1783) - PeakReservation: 1.51 GB (1619001344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.31 GB (1406140416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 931.994ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1947432) - Rows rejected: 45.49K (45488) - Rows total: 544.40M (544402237) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.90M (1901944) - Rows rejected: 23.01K (23006) - Rows total: 544.36M (544356749) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.82M (1822753) - Rows rejected: 11.10K (11100) - Rows total: 544.33M (544333743) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.81M (1809605) - Rows rejected: 0 (0) - Rows total: 544.32M (544322643) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 596 (596) - Files rejected: 481 (481) - Files total: 596 (596) - RowGroups processed: 531.59K (531589) - RowGroups rejected: 0 (0) - RowGroups total: 531.59K (531589) - Rows processed: 1.87M (1867973) - Rows rejected: 0 (0) - Rows total: 544.32M (544322643) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) CodeGen:(Total: 943.994ms, non-child: 943.994ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 943.994ms - CodegenSysTime: 3.987ms - CodegenUserTime: 939.998ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 283.998ms - IrGenerationTime: 31.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 611.996ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f0000001f (host=impala-executor-000-4:22000):(Total: 2m38s, non-child: 4.000ms, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:36.082 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:597/139.06 GB Filter 0 arrival: 928ms Filter 2 arrival: 928ms Filter 8 arrival: 927ms Filter 4 arrival: 1s371ms Filter 6 arrival: 8s022ms Fragment Instance Lifecycle Event Timeline: 2m38s - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 2m38s (2m38s) - First Batch Produced: 2m38s (0.000ns) - First Batch Sent: 2m38s (0.000ns) - ExecInternal Finished: 2m38s (0.000ns) - MemoryUsage (4s000ms): 1.24 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.64 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.64 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.57 GB, 1.48 GB, 1.17 GB, 708.32 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB, 282.23 MB - ThreadUsage (4s000ms): 11, 15, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 12, 9, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 8.46 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.65 GB (1767700928) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1786101518) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1s364ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 6s412ms - TotalThreadsInvoluntaryContextSwitches: 1.02K (1024) - TotalThreadsTotalWallClockTime: 22m23s - TotalThreadsSysTime: 32s794ms - TotalThreadsUserTime: 2m48s - TotalThreadsVoluntaryContextSwitches: 579.09K (579090) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m38s - ExecTreeOpenTime: 2m37s - PrepareTime: 4.000ms - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 157.74 KB/sec ; Min: 157.74 KB/sec ; Max: 157.74 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 208.840us ; Min: 101.949us ; Max: 315.732us ; Number of samples: 2) - RpcRecvrTime: (Avg: 36.409us ; Min: 17.498us ; Max: 55.320us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m37s, non-child: 36.000ms, % non-child: 0.02%) Node Lifecycle Event Timeline: 2m38s - Open Started: 924.003ms (924.003ms) - Open Finished: 2m38s (2m37s) - First Batch Requested: 2m38s (0.000ns) - First Batch Returned: 2m38s (0.000ns) - Last Batch Returned: 2m38s (0.000ns) - Closed: 2m38s (0.000ns) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 4.000ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m37s, non-child: 688.003ms, % non-child: 0.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m38s - Open Started: 924.003ms (924.003ms) - Open Finished: 1m34s (1m33s) - First Batch Requested: 1m34s (0.000ns) - First Batch Returned: 1m34s (0.000ns) - Last Batch Returned: 2m38s (1m4s) - Closed: 2m38s (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.29M (6286206) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 668.003ms - RowsReturned: 8.50K (8496) - RowsReturnedRate: 53.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.28M (6283362) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 928.003ms - Open Started: 924.003ms (924.003ms) - Open Finished: 924.003ms (0.000ns) - First Batch Requested: 924.003ms (0.000ns) - First Batch Returned: 924.003ms (0.000ns) - Last Batch Returned: 924.003ms (0.000ns) - Closed: 928.003ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 22.322us ; Min: 15.346us ; Max: 41.272us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m36s, non-child: 180.000ms, % non-child: 0.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m38s - Open Started: 924.003ms (924.003ms) - Open Finished: 1m34s (1m33s) - First Batch Requested: 1m34s (0.000ns) - First Batch Returned: 1m34s (4.000ms) - Last Batch Returned: 2m38s (1m4s) - Closed: 2m38s (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.31M (6305156) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 144.000ms - RowsReturned: 6.29M (6286206) - RowsReturnedRate: 40.05 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.29M (6287706) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 928.003ms - Open Started: 924.003ms (924.003ms) - Open Finished: 924.003ms (0.000ns) - First Batch Requested: 924.003ms (0.000ns) - First Batch Returned: 924.003ms (0.000ns) - Last Batch Returned: 924.003ms (0.000ns) - Closed: 928.003ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 31.503us ; Min: 27.651us ; Max: 35.356us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m36s, non-child: 9s336ms, % non-child: 5.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m38s - Open Started: 924.003ms (924.003ms) - Open Finished: 1m34s (1m33s) - First Batch Requested: 1m34s (0.000ns) - First Batch Returned: 1m34s (0.000ns) - Last Batch Returned: 2m38s (1m4s) - Closed: 2m38s (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 340.001ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 74.13 MB (77725952) - ProbeRows: 6.35M (6345777) - ProbeRowsPartitioned: 4.74M (4739975) - ProbeTime: 1s476ms - RowsReturned: 6.31M (6305156) - RowsReturnedRate: 40.21 K/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 804.00 MB (843055104) - CumulativeAllocations: 385 (385) - PeakReservation: 66.00 MB (69206016) - PeakUnpinnedBytes: 640.00 MB (671088640) - PeakUsedReservation: 64.00 MB (67108864) - ReadIoBytes: 72.00 MB (75497472) - ReadIoOps: 36 (36) - ReadIoWaitTime: 16.000ms - SystemAllocTime: 4.000ms - WriteIoBytes: 640.00 MB (671088640) - WriteIoOps: 320 (320) - WriteIoWaitTime: 28.000ms Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 292.001ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 92.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 12 (12) Hash Table: - HashBuckets: 4.46M (4456448) - HashCollisions: 0 (0) - Probes: 8.23M (8225956) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 156.000ms, non-child: 24.000ms, % non-child: 15.38%) Node Lifecycle Event Timeline: 1s420ms - Open Started: 924.003ms (924.003ms) - Open Finished: 924.003ms (0.000ns) - First Batch Requested: 924.003ms (0.000ns) - First Batch Returned: 924.003ms (0.000ns) - Last Batch Returned: 1s372ms (448.001ms) - Closed: 1s420ms (48.000ms) - ConvertRowBatchTime: 24.000ms - PeakMemoryUsage: 14.29 MB (14980349) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 12.31 M/sec Buffer pool: - AllocTime: 8.000ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 8.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 74.52 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 132.000ms - DataWaitTime: 132.000ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 4.79 MB, 34.39 MB - DeferredQueueSize (500.000ms): 10, 10, 0 - DispatchTime: (Avg: 29.506us ; Min: 7.369us ; Max: 4.083ms ; Number of samples: 1881) - DeserializeRowBatchTime: 88.000ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 884.576ms - TotalRPCsDeferred: 11 (11) HASH_JOIN_NODE (id=7):(Total: 2m27s, non-child: 2m12s, % non-child: 90.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m38s - Open Started: 924.003ms (924.003ms) - Open Finished: 8s064ms (7s140ms) - First Batch Requested: 8s064ms (0.000ns) - First Batch Returned: 8s092ms (27.999ms) - Last Batch Returned: 2m37s (2m29s) - Closed: 2m38s (1s000ms) - BuildRows: 31.53M (31525830) - BuildTime: 5s596ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 544.89M (544892097) - ProbeRowsPartitioned: 532.11M (532106718) - ProbeTime: 1m46s - RowsReturned: 6.35M (6345777) - RowsReturnedRate: 43.04 K/sec Buffer pool: - AllocTime: 4s627ms - CumulativeAllocationBytes: 70.53 GB (75726061568) - CumulativeAllocations: 35.61K (35613) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 38.62 GB (41471180800) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 30.90 GB (33181138944) - ReadIoOps: 15.82K (15822) - ReadIoWaitTime: 14s980ms - SystemAllocTime: 4s607ms - WriteIoBytes: 38.62 GB (41471180800) - WriteIoOps: 19.77K (19775) - WriteIoWaitTime: 29s828ms Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5s544ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 1s832ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 563.63M (563632548) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 1s527ms, non-child: 343.999ms, % non-child: 22.51%) Node Lifecycle Event Timeline: 8s064ms - Open Started: 924.003ms (924.003ms) - Open Finished: 924.003ms (0.000ns) - First Batch Requested: 928.003ms (4.000ms) - First Batch Returned: 928.003ms (0.000ns) - Last Batch Returned: 8s024ms (7s096ms) - Closed: 8s064ms (39.999ms) - ConvertRowBatchTime: 295.999ms - PeakMemoryUsage: 13.10 MB (13737658) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 20.63 M/sec Buffer pool: - AllocTime: 88.000ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 76.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 58.54 MB, 162.28 MB, 281.59 MB, 406.43 MB, 522.80 MB, 645.83 MB, 774.93 MB, 896.21 MB, 1019.19 MB, 1.12 GB, 1.24 GB, 1.36 GB, 1.48 GB, 1.59 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 1s227ms - DataWaitTime: 1s183ms Enqueue: - BytesReceived (500.000ms): 4.62 MB, 4.62 MB, 27.97 MB, 72.53 MB, 125.86 MB, 181.70 MB, 236.88 MB, 288.65 MB, 346.35 MB, 403.17 MB, 455.52 MB, 512.07 MB, 568.16 MB, 622.20 MB, 677.74 MB, 726.84 MB - DeferredQueueSize (500.000ms): 7, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 16.966us ; Min: 5.558us ; Max: 4.229ms ; Number of samples: 30799) - DeserializeRowBatchTime: 1s428ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 879.914ms - TotalRPCsDeferred: 24 (24) HASH_JOIN_NODE (id=6):(Total: 13s112ms, non-child: 10s236ms, % non-child: 78.07%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m38s - Open Started: 924.003ms (924.003ms) - Open Finished: 1s080ms (156.000ms) - First Batch Requested: 8s064ms (6s984ms) - First Batch Returned: 8s064ms (0.000ns) - Last Batch Returned: 1m34s (1m26s) - Closed: 2m38s (1m4s) - BuildRows: 365 (365) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 544.89M (544892097) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s064ms - RowsReturned: 544.89M (544892097) - RowsReturnedRate: 41.56 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 544.89M (544892462) - Resizes: 0 (0) - Travel: 213.67M (213669185) EXCHANGE_NODE (id=12): Node Lifecycle Event Timeline: 928.003ms - Open Started: 924.003ms (924.003ms) - Open Finished: 924.003ms (0.000ns) - First Batch Requested: 928.003ms (4.000ms) - First Batch Returned: 928.003ms (0.000ns) - Last Batch Returned: 928.003ms (0.000ns) - Closed: 928.003ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 19.330us ; Min: 19.330us ; Max: 19.330us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s876ms, non-child: 2s876ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:597/139.06 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: Not all filters arrived (arrived: [0, 2, 8], missing [4, 6]), waited for 72ms. Arrival delay: 1s000ms. Hdfs Read Thread Concurrency Bucket: 0:75.94% 1:6.417% 2:9.626% 3:3.209% 4:2.674% 5:1.07% 6:0% 7:0.5348% 8:0.5348% File Formats: PARQUET/SNAPPY:116 PARQUET/Unknown(Skipped):481 Node Lifecycle Event Timeline: 2m38s - Open Started: 924.003ms (924.003ms) - Open Finished: 924.003ms (0.000ns) - First Batch Requested: 928.003ms (4.000ms) - First Batch Returned: 1s080ms (152.000ms) - Last Batch Returned: 1m34s (1m33s) - Closed: 2m38s (1m4s) - BytesRead (2s000ms): 547.23 MB, 1.12 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.25 GB, 1.44 GB, 1.79 GB, 2.21 GB, 2.25 GB, 2.62 GB, 3.11 GB, 3.41 GB, 3.66 GB, 4.29 GB, 4.62 GB, 4.81 GB, 5.37 GB, 5.84 GB, 5.97 GB, 6.51 GB, 6.95 GB, 7.19 GB, 7.60 GB, 7.88 GB, 8.06 GB, 8.26 GB, 8.45 GB, 8.47 GB, 8.55 GB, 9.01 GB, 9.10 GB, 9.17 GB, 9.25 GB, 9.35 GB, 9.48 GB, 9.57 GB, 9.74 GB, 10.00 GB, 10.29 GB, 10.29 GB, 10.29 GB, 10.30 GB, 10.31 GB, 10.31 GB - FooterProcessingTime: (Avg: 206.896us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 116) - InitialRangeActualReservation: (Avg: 107.93 MB (113173892) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 116) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 116) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1215314309) ; Min: 471.51 MB (494415811) ; Max: 2.00 GB (2148389721) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.69 KB (41666) ; Min: 11.00 B (11) ; Max: 70.31 KB (71999) ; Number of samples: 262511) - ParquetRowGroupActualReservation: (Avg: 116.48 MB (122141025) ; Min: 88.00 MB (92274688) ; Max: 128.00 MB (134217728) ; Number of samples: 116) - ParquetRowGroupIdealReservation: (Avg: 118.83 MB (124599755) ; Min: 88.00 MB (92274688) ; Max: 144.00 MB (150994944) ; Number of samples: 116) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1929726848) ; Min: 484.44 MB (507973063) ; Max: 3.66 GB (3933792404) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.61 KB (66159) ; Min: 9.00 B (9) ; Max: 71.14 KB (72850) ; Number of samples: 262511) - AverageHdfsReadThreadConcurrency: 0.59 - AverageScannerThreadConcurrency: 12.57 - BytesRead: 10.31 GB (11072997104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 1.86K (1864) - CachedFileHandlesMissCount: 5 (5) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 9.92 GB (10651446098) - DataCacheHitCount: 1.81K (1811) - DataCacheMissBytes: 402.02 MB (421551006) - DataCacheMissCount: 58 (58) - DataCachePartialHitCount: 12 (12) - DecompressionTime: 8s592ms - MaterializeTupleTime(*): 1m1s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 262.51K (262511) - NumRowGroups: 116 (116) - NumRowGroupsWithPageIndex: 116 (116) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.51 GB (1622612221) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 189.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.47 GB (33792851968) - RowBatchQueueGetWaitTime: 76.000ms - RowBatchQueuePeakMemoryUsage: 6.48 MB (6793216) - RowBatchQueuePutWaitTime: 18m14s - RowBatchesEnqueued: 532.38K (532380) - RowsRead: 544.97M (544974189) - RowsReturned: 544.89M (544892097) - RowsReturnedRate: 189.46 M/sec - ScanRangesComplete: 597 (597) - ScannerIoWaitTime: 6s412ms - ScannerThreadWorklessLoops: 39 (39) - ScannerThreadsInvoluntaryContextSwitches: 655 (655) - ScannerThreadsTotalWallClockTime: 19m36s - ScannerThreadsSysTime: 14s970ms - ScannerThreadsUserTime: 1m3s - ScannerThreadsVoluntaryContextSwitches: 543.02K (543017) - TotalRawHdfsOpenFileTime(*): 135.999ms - TotalRawHdfsReadTime(*): 55s764ms - TotalReadThroughput: 111.75 MB/sec Buffer pool: - AllocTime: 1s020ms - CumulativeAllocationBytes: 11.30 GB (12132941824) - CumulativeAllocations: 1.74K (1738) - PeakReservation: 1.48 GB (1585446912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.31 GB (1407188992) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1s020ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1981979) - Rows rejected: 46.51K (46512) - Rows total: 544.97M (544974189) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935467) - Rows rejected: 23.56K (23559) - Rows total: 544.93M (544927677) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.88M (1881845) - Rows rejected: 12.02K (12021) - Rows total: 544.90M (544904118) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.87M (1869824) - Rows rejected: 0 (0) - Rows total: 544.89M (544892097) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 597 (597) - Files rejected: 481 (481) - Files total: 597 (597) - RowGroups processed: 532.15K (532148) - RowGroups rejected: 0 (0) - RowGroups total: 532.15K (532148) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 544.89M (544892097) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) CodeGen:(Total: 920.003ms, non-child: 920.003ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 920.003ms - CodegenSysTime: 0.000ns - CodegenUserTime: 919.962ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 280.000ms - IrGenerationTime: 28.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 600.002ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 12.000ms Instance 554562a26c33f0c6:2ec25d2f0000001b (host=impala-executor-000-2:22000):(Total: 2m37s, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:58:35.324 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:601/139.04 GB Filter 0 arrival: 948ms Filter 2 arrival: 948ms Filter 8 arrival: 948ms Filter 4 arrival: 1s369ms Filter 6 arrival: 8s019ms Fragment Instance Lifecycle Event Timeline: 2m37s - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 2m37s (2m37s) - First Batch Produced: 2m37s (0.000ns) - First Batch Sent: 2m37s (0.000ns) - ExecInternal Finished: 2m37s (0.000ns) - MemoryUsage (4s000ms): 1.23 GB, 1.62 GB, 1.62 GB, 1.62 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.44 GB, 739.16 MB, 301.32 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB, 268.23 MB - ThreadUsage (4s000ms): 11, 15, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 12, 6, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 8.34 - BloomFilterBytes: 12.00 MB (12582912) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.64 GB (1760518416) - PeakReservation: 1.60 GB (1713176576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785995032) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 860.000ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 3s020ms - TotalThreadsInvoluntaryContextSwitches: 1.00K (1001) - TotalThreadsTotalWallClockTime: 21m58s - TotalThreadsSysTime: 32s381ms - TotalThreadsUserTime: 2m52s - TotalThreadsVoluntaryContextSwitches: 574.01K (574012) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 12.00 MB (12582912) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.00 MB (12582912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 12.00 MB (12582912) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 2m37s - ExecTreeOpenTime: 2m36s - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (4s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 166.61 KB/sec ; Min: 166.61 KB/sec ; Max: 166.61 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 198.562us ; Min: 98.200us ; Max: 298.924us ; Number of samples: 2) - RpcRecvrTime: (Avg: 38.681us ; Min: 16.857us ; Max: 60.505us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 2m36s, non-child: 52.000ms, % non-child: 0.03%) Node Lifecycle Event Timeline: 2m37s - Open Started: 940.000ms (940.000ms) - Open Finished: 2m37s (2m36s) - First Batch Requested: 2m37s (0.000ns) - First Batch Returned: 2m37s (0.000ns) - Last Batch Returned: 2m37s (0.000ns) - Closed: 2m37s (0.000ns) - PeakMemoryUsage: 56.00 KB (57344) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m36s, non-child: 632.000ms, % non-child: 0.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m37s - Open Started: 940.000ms (940.000ms) - Open Finished: 1m33s (1m32s) - First Batch Requested: 1m33s (0.000ns) - First Batch Returned: 1m33s (0.000ns) - Last Batch Returned: 2m37s (1m4s) - Closed: 2m37s (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.02 MB (2119936) - ProbeRows: 6.30M (6298054) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 628.000ms - RowsReturned: 7.94K (7937) - RowsReturnedRate: 50.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.30M (6295347) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 948.000ms - Open Started: 940.000ms (940.000ms) - Open Finished: 940.000ms (0.000ns) - First Batch Requested: 940.000ms (0.000ns) - First Batch Returned: 940.000ms (0.000ns) - Last Batch Returned: 940.000ms (0.000ns) - Closed: 948.000ms (8.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 20.735us ; Min: 15.431us ; Max: 30.593us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m36s, non-child: 204.000ms, % non-child: 0.13%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m37s - Open Started: 940.000ms (940.000ms) - Open Finished: 1m33s (1m32s) - First Batch Requested: 1m33s (0.000ns) - First Batch Returned: 1m33s (0.000ns) - Last Batch Returned: 2m37s (1m4s) - Closed: 2m37s (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 MB (2107648) - ProbeRows: 6.32M (6319395) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 196.000ms - RowsReturned: 6.30M (6298054) - RowsReturnedRate: 40.31 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.30M (6299554) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 948.000ms - Open Started: 940.000ms (940.000ms) - Open Finished: 940.000ms (0.000ns) - First Batch Requested: 940.000ms (0.000ns) - First Batch Returned: 940.000ms (0.000ns) - Last Batch Returned: 940.000ms (0.000ns) - Closed: 948.000ms (8.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 31.727us ; Min: 20.775us ; Max: 42.679us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 2m36s, non-child: 9s084ms, % non-child: 5.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m37s - Open Started: 940.000ms (940.000ms) - Open Finished: 1m33s (1m32s) - First Batch Requested: 1m33s (0.000ns) - First Batch Returned: 1m33s (0.000ns) - Last Batch Returned: 2m37s (1m4s) - Closed: 2m37s (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 412.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 60.16 MB (63084800) - ProbeRows: 6.36M (6358201) - ProbeRowsPartitioned: 5.54M (5543894) - ProbeTime: 1s724ms - RowsReturned: 6.32M (6319395) - RowsReturnedRate: 40.50 K/sec Buffer pool: - AllocTime: 36.000ms - CumulativeAllocationBytes: 890.00 MB (933232640) - CumulativeAllocations: 428 (428) - PeakReservation: 52.00 MB (54525952) - PeakUnpinnedBytes: 750.00 MB (786432000) - PeakUsedReservation: 52.00 MB (54525952) - ReadIoBytes: 60.00 MB (62914560) - ReadIoOps: 30 (30) - ReadIoWaitTime: 24.000ms - SystemAllocTime: 32.000ms - WriteIoBytes: 750.00 MB (786432000) - WriteIoOps: 375 (375) - WriteIoWaitTime: 16.000ms Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 352.000ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 84.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 14 (14) Hash Table: - HashBuckets: 4.46M (4456448) - HashCollisions: 0 (0) - Probes: 8.24M (8240195) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 76.000ms, non-child: 8.000ms, % non-child: 10.53%) Node Lifecycle Event Timeline: 1s428ms - Open Started: 940.000ms (940.000ms) - Open Finished: 940.000ms (0.000ns) - First Batch Requested: 940.000ms (0.000ns) - First Batch Returned: 940.000ms (0.000ns) - Last Batch Returned: 1s368ms (428.000ms) - Closed: 1s428ms (60.000ms) - ConvertRowBatchTime: 8.000ms - PeakMemoryUsage: 14.26 MB (14955894) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 25.27 M/sec Buffer pool: - AllocTime: 28.000ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.09 MB (14778368) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.09 MB (14778368) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 20.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 94.47 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 68.000ms - DataWaitTime: 68.000ms Enqueue: - BytesReceived (500.000ms): 4.75 MB, 4.75 MB, 43.22 MB - DeferredQueueSize (500.000ms): 8, 8, 0 - DispatchTime: (Avg: 27.901us ; Min: 6.200us ; Max: 3.052ms ; Number of samples: 1881) - DeserializeRowBatchTime: 112.000ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 918.088ms - TotalRPCsDeferred: 27 (27) HASH_JOIN_NODE (id=7):(Total: 2m26s, non-child: 2m11s, % non-child: 89.69%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m37s - Open Started: 940.000ms (940.000ms) - Open Finished: 8s060ms (7s120ms) - First Batch Requested: 8s060ms (0.000ns) - First Batch Returned: 8s088ms (28.000ms) - Last Batch Returned: 2m36s (2m28s) - Closed: 2m37s (1s288ms) - BuildRows: 31.53M (31525830) - BuildTime: 5s976ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 158.05 MB (165730560) - ProbeRows: 545.70M (545697602) - ProbeRowsPartitioned: 532.87M (532870378) - ProbeTime: 1m44s - RowsReturned: 6.36M (6358201) - RowsReturnedRate: 43.27 K/sec Buffer pool: - AllocTime: 4s692ms - CumulativeAllocationBytes: 70.63 GB (75835113472) - CumulativeAllocations: 35.66K (35665) - PeakReservation: 158.00 MB (165675008) - PeakUnpinnedBytes: 38.67 GB (41523609600) - PeakUsedReservation: 158.00 MB (165675008) - ReadIoBytes: 30.96 GB (33237762048) - ReadIoOps: 15.85K (15849) - ReadIoWaitTime: 15s084ms - SystemAllocTime: 4s664ms - WriteIoBytes: 38.67 GB (41523609600) - WriteIoOps: 19.80K (19800) - WriteIoWaitTime: 26s892ms Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 5s924ms - BuildRowsPartitioned: 31.53M (31525830) - HashTablesBuildTime: 2s032ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 16 (16) Hash Table: - HashBuckets: 67.11M (67108864) - HashCollisions: 0 (0) - Probes: 564.40M (564396208) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=13):(Total: 1s108ms, non-child: 372.000ms, % non-child: 33.57%) Node Lifecycle Event Timeline: 8s060ms - Open Started: 940.000ms (940.000ms) - Open Finished: 940.000ms (0.000ns) - First Batch Requested: 944.000ms (4.000ms) - First Batch Returned: 944.000ms (0.000ns) - Last Batch Returned: 8s016ms (7s072ms) - Closed: 8s060ms (44.000ms) - ConvertRowBatchTime: 300.000ms - PeakMemoryUsage: 13.15 MB (13789307) - RowsReturned: 31.53M (31525830) - RowsReturnedRate: 28.45 M/sec Buffer pool: - AllocTime: 84.000ms - CumulativeAllocationBytes: 2.11 GB (2269986816) - CumulativeAllocations: 61.60K (61598) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 68.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 78.49 MB, 194.20 MB, 313.73 MB, 439.12 MB, 559.96 MB, 679.94 MB, 808.76 MB, 933.33 MB, 1.03 GB, 1.15 GB, 1.27 GB, 1.39 GB, 1.51 GB, 1.62 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.64 GB (1764470936) - TotalGetBatchTime: 780.000ms - DataWaitTime: 736.000ms Enqueue: - BytesReceived (500.000ms): 4.67 MB, 4.67 MB, 38.26 MB, 88.29 MB, 140.25 MB, 196.53 MB, 251.98 MB, 305.24 MB, 361.47 MB, 418.32 MB, 472.06 MB, 527.07 MB, 583.33 MB, 638.84 MB, 690.96 MB, 739.89 MB - DeferredQueueSize (500.000ms): 9, 9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 17.624us ; Min: 4.587us ; Max: 2.024ms ; Number of samples: 30799) - DeserializeRowBatchTime: 1s472ms - TotalBatchesEnqueued: 30.80K (30799) - TotalBatchesReceived: 30.80K (30799) - TotalBytesReceived: 752.08 MB (788616634) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 1s098ms - TotalRPCsDeferred: 179 (179) HASH_JOIN_NODE (id=6):(Total: 14s072ms, non-child: 11s048ms, % non-child: 78.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 2m37s - Open Started: 940.000ms (940.000ms) - Open Finished: 1s084ms (144.000ms) - First Batch Requested: 8s060ms (6s976ms) - First Batch Returned: 8s060ms (0.000ns) - Last Batch Returned: 1m33s (1m25s) - Closed: 2m37s (1m4s) - BuildRows: 365 (365) - BuildTime: 8.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.09 MB (2193664) - ProbeRows: 545.70M (545697602) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 10s776ms - RowsReturned: 545.70M (545697602) - RowsReturnedRate: 38.78 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 545.70M (545697967) - Resizes: 0 (0) - Travel: 198.82M (198822626) EXCHANGE_NODE (id=12): Node Lifecycle Event Timeline: 948.000ms - Open Started: 940.000ms (940.000ms) - Open Finished: 940.000ms (0.000ns) - First Batch Requested: 948.000ms (8.000ms) - First Batch Returned: 948.000ms (0.000ns) - Last Batch Returned: 948.000ms (0.000ns) - Closed: 948.000ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 26.986us ; Min: 26.986us ; Max: 26.986us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 3s024ms, non-child: 3s024ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:601/139.04 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 113 out of 113 Runtime filters: Not all filters arrived (arrived: [0, 2, 8], missing [4, 6]), waited for 51ms. Arrival delay: 1s000ms. Hdfs Read Thread Concurrency Bucket: 0:79.89% 1:8.152% 2:5.978% 3:2.174% 4:1.087% 5:1.63% 6:1.087% 7:0% 8:0% File Formats: PARQUET/SNAPPY:113 PARQUET/Unknown(Skipped):488 Node Lifecycle Event Timeline: 2m37s - Open Started: 940.000ms (940.000ms) - Open Finished: 940.000ms (0.000ns) - First Batch Requested: 948.000ms (8.000ms) - First Batch Returned: 1s084ms (136.000ms) - Last Batch Returned: 1m33s (1m32s) - Closed: 2m37s (1m4s) - BytesRead (2s000ms): 546.26 MB, 1.13 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.14 GB, 1.22 GB, 1.46 GB, 1.86 GB, 2.31 GB, 2.33 GB, 2.49 GB, 3.04 GB, 3.55 GB, 3.62 GB, 4.09 GB, 4.69 GB, 4.80 GB, 5.23 GB, 5.86 GB, 6.04 GB, 6.37 GB, 6.96 GB, 7.30 GB, 7.56 GB, 7.95 GB, 8.46 GB, 8.66 GB, 8.70 GB, 8.79 GB, 8.92 GB, 8.93 GB, 9.18 GB, 9.46 GB, 9.65 GB, 9.65 GB, 9.72 GB, 9.82 GB, 9.95 GB, 9.96 GB, 10.07 GB, 10.27 GB, 10.30 GB, 10.30 GB, 10.31 GB - FooterProcessingTime: (Avg: 141.593us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 113) - InitialRangeActualReservation: (Avg: 108.11 MB (113357561) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 113) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 113) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1215978366) ; Min: 472.21 MB (495146383) ; Max: 2.00 GB (2151786072) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.61 KB (41587) ; Min: 11.00 B (11) ; Max: 67.90 KB (69532) ; Number of samples: 263151) - ParquetRowGroupActualReservation: (Avg: 117.03 MB (122711230) ; Min: 88.00 MB (92274688) ; Max: 136.00 MB (142606336) ; Number of samples: 113) - ParquetRowGroupIdealReservation: (Avg: 122.65 MB (128612950) ; Min: 88.00 MB (92274688) ; Max: 144.00 MB (150994944) ; Number of samples: 113) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1934164469) ; Min: 485.17 MB (508735505) ; Max: 3.68 GB (3947832422) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.60 KB (66150) ; Min: 9.00 B (9) ; Max: 69.69 KB (71362) ; Number of samples: 263151) - AverageHdfsReadThreadConcurrency: 0.46 - AverageScannerThreadConcurrency: 12.49 - BytesRead: 10.32 GB (11075658052) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 1.86K (1858) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 9.99 GB (10732046578) - DataCacheHitCount: 1.82K (1820) - DataCacheMissBytes: 327.69 MB (343611474) - DataCacheMissCount: 44 (44) - DataCachePartialHitCount: 4 (4) - DecompressionTime: 8s760ms - MaterializeTupleTime(*): 1m2s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 263.15K (263151) - NumRowGroups: 113 (113) - NumRowGroupsWithPageIndex: 113 (113) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.53 GB (1640808950) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 231.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.52 GB (33842106368) - RowBatchQueueGetWaitTime: 84.000ms - RowBatchQueuePeakMemoryUsage: 6.48 MB (6793216) - RowBatchQueuePutWaitTime: 17m53s - RowBatchesEnqueued: 533.15K (533153) - RowsRead: 545.78M (545777149) - RowsReturned: 545.70M (545697602) - RowsReturnedRate: 180.46 M/sec - ScanRangesComplete: 601 (601) - ScannerIoWaitTime: 3s020ms - ScannerThreadWorklessLoops: 26 (26) - ScannerThreadsInvoluntaryContextSwitches: 643 (643) - ScannerThreadsTotalWallClockTime: 19m13s - ScannerThreadsSysTime: 14s884ms - ScannerThreadsUserTime: 1m3s - ScannerThreadsVoluntaryContextSwitches: 542.81K (542807) - TotalRawHdfsOpenFileTime(*): 128.000ms - TotalRawHdfsReadTime(*): 45s576ms - TotalReadThroughput: 113.58 MB/sec Buffer pool: - AllocTime: 872.000ms - CumulativeAllocationBytes: 11.22 GB (12051480576) - CumulativeAllocations: 1.75K (1750) - PeakReservation: 1.49 GB (1602224128) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.31 GB (1407254528) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 868.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1930529) - Rows rejected: 45.34K (45345) - Rows total: 545.78M (545777149) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.89M (1885184) - Rows rejected: 22.82K (22820) - Rows total: 545.73M (545731804) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.82M (1815670) - Rows rejected: 11.38K (11382) - Rows total: 545.71M (545708984) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (8.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.80M (1804288) - Rows rejected: 0 (0) - Rows total: 545.70M (545697602) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (1.00 MB): - Files processed: 601 (601) - Files rejected: 488 (488) - Files total: 601 (601) - RowGroups processed: 532.93K (532927) - RowGroups rejected: 0 (0) - RowGroups total: 532.93K (532927) - Rows processed: 1.85M (1851392) - Rows rejected: 0 (0) - Rows total: 545.70M (545697602) - Splits processed: 113 (113) - Splits rejected: 0 (0) - Splits total: 113 (113) CodeGen:(Total: 940.000ms, non-child: 940.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 940.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 938.446ms - CodegenVoluntaryContextSwitches: 5 (5) - CompileTime: 288.000ms - IrGenerationTime: 32.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 604.000ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 12.000ms Averaged Fragment F01:(Total: 40.000ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:5s016ms max:5s016ms mean: 5s016ms stddev:0.000ns execution rates: min:439.87 KB/sec max:439.87 KB/sec mean:439.87 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.06 - PeakMemoryUsage: 1.74 MB (1819312) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785995032) - RowsProduced: 365 (365) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 44.000ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 39.472ms - TotalThreadsVoluntaryContextSwitches: 28 (28) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 4.000ms - OpenTime: 36.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12): - EosSent: 10 (10) - PeakMemoryUsage: 98.44 KB (100800) - RowsSent: 365 (365) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 28.70 KB (29390) - UncompressedRowBatchSize: 74.85 KB (76650) HDFS_SCAN_NODE (id=5):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 466.80 KB (478002) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 466.80 KB (478002) - DataCacheHitCount: 4 (4) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 9 (9) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 2 (2) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.63 MB (1709860) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 26.00 KB (26624) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 29.00 KB (29696) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 65.10K (65100) - RowsReturned: 365 (365) - RowsReturnedRate: 91.25 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.000ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1.337ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 648.00 KB (663552) - CumulativeAllocations: 3 (3) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 520.00 KB (532480) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 36.000ms, non-child: 36.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 36.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 35.688ms - CodegenVoluntaryContextSwitches: 3 (3) - CompileTime: 8.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 18 (18) - NumInstructions: 344 (344) - OptimizationTime: 12.000ms - PeakMemoryUsage: 172.00 KB (176128) - PrepareTime: 12.000ms Fragment F01: Instance 554562a26c33f0c6:2ec25d2f00000001 (host=impala-executor-000-2:22000):(Total: 40.000ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:56:02.476 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.15 MB Fragment Instance Lifecycle Event Timeline: 40.000ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 36.000ms (36.000ms) - First Batch Produced: 40.000ms (4.000ms) - First Batch Sent: 40.000ms (0.000ns) - ExecInternal Finished: 40.000ms (0.000ns) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.06 - PeakMemoryUsage: 1.74 MB (1819312) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785995032) - RowsProduced: 365 (365) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 44.000ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 39.472ms - TotalThreadsVoluntaryContextSwitches: 28 (28) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 4.000ms - OpenTime: 36.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - NetworkThroughput: (Avg: 13.40 MB/sec ; Min: 10.73 MB/sec ; Max: 25.69 MB/sec ; Number of samples: 10) - RpcNetworkTime: (Avg: 188.363us ; Min: 76.018us ; Max: 261.140us ; Number of samples: 20) - RpcRecvrTime: (Avg: 32.908us ; Min: 14.077us ; Max: 53.443us ; Number of samples: 20) - EosSent: 10 (10) - PeakMemoryUsage: 98.44 KB (100800) - RowsSent: 365 (365) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 28.70 KB (29390) - UncompressedRowBatchSize: 74.85 KB (76650) HDFS_SCAN_NODE (id=5):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 40.000ms - Open Started: 36.000ms (36.000ms) - Open Finished: 36.000ms (0.000ns) - First Batch Requested: 36.000ms (0.000ns) - First Batch Returned: 40.000ms (4.000ms) - Last Batch Returned: 40.000ms (0.000ns) - Closed: 40.000ms (0.000ns) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - ParquetCompressedBytesReadPerColumn: (Avg: 103.45 KB (105934) ; Min: 551.00 B (551) ; Max: 206.37 KB (211318) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 29.56 KB (30267) ; Min: 551.00 B (551) ; Max: 64.14 KB (65683) ; Number of samples: 7) - ParquetRowGroupActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 520.00 KB (532480) ; Min: 520.00 KB (532480) ; Max: 520.00 KB (532480) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 167.39 KB (171410) ; Min: 546.00 B (546) ; Max: 334.25 KB (342274) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 47.83 KB (48974) ; Min: 546.00 B (546) ; Max: 64.14 KB (65675) ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 466.80 KB (478002) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 466.80 KB (478002) - DataCacheHitCount: 4 (4) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 9 (9) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 2 (2) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.63 MB (1709860) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 26.00 KB (26624) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 29.00 KB (29696) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 65.10K (65100) - RowsReturned: 365 (365) - RowsReturnedRate: 91.25 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.000ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1.337ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 648.00 KB (663552) - CumulativeAllocations: 3 (3) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 520.00 KB (532480) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 36.000ms, non-child: 36.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 36.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 35.688ms - CodegenVoluntaryContextSwitches: 3 (3) - CompileTime: 8.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 18 (18) - NumInstructions: 344 (344) - OptimizationTime: 12.000ms - PeakMemoryUsage: 172.00 KB (176128) - PrepareTime: 12.000ms Averaged Fragment F02:(Total: 6s955ms, non-child: 18.666ms, % non-child: 0.27%) split sizes: min: 29.99 MB, max: 89.95 MB, avg: 66.63 MB, stddev: 18.84 MB completion times: min:5s012ms max:10s016ms mean: 9s459ms stddev:1s572ms execution rates: min:5.97 MB/sec max:8.98 MB/sec mean:6.99 MB/sec stddev:1.41 MB/sec num instances: 9 - AverageThreadTokens: 3.19 - BloomFilterBytes: 0 - ExchangeScanRatio: 48.98 - PeakMemoryUsage: 27.39 MB (28720126) - PeakReservation: 22.50 MB (23592960) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785318994) - RowsProduced: 3.50M (3502870) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s137ms - TotalStorageWaitTime: 9.333ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 22s756ms - TotalThreadsSysTime: 185.996ms - TotalThreadsUserTime: 824.634ms - TotalThreadsVoluntaryContextSwitches: 7.05K (7047) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s911ms - ExecTreeExecTime: 36.444ms - OpenTime: 42.666ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 888.889us - ExecTreePrepareTime: 444.443us KrpcDataStreamSender (dst_id=13):(Total: 6s859ms, non-child: 6s859ms, % non-child: 100.00%) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 3.50M (3502870) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 480.444ms - TotalBytesSent: 835.65 MB (876240704) - UncompressedRowBatchSize: 1.83 GB (1960523262) HDFS_SCAN_NODE (id=4):(Total: 34.666ms, non-child: 34.666ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.19 - BytesRead: 17.06 MB (17890628) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 11 (11) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 17.06 MB (17890628) - DataCacheHitCount: 11 (11) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 39.111ms - MaterializeTupleTime(*): 92.888ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 486 (486) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 27.30 MB (28630361) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 2.26 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 116.57 MB (122227909) - RowBatchQueueGetWaitTime: 6.222ms - RowBatchQueuePeakMemoryUsage: 3.64 MB (3813437) - RowBatchQueuePutWaitTime: 15s626ms - RowBatchesEnqueued: 3.42K (3424) - RowsRead: 3.61M (3611111) - RowsReturned: 3.50M (3502870) - RowsReturnedRate: 114.52 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 9.333ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 15s801ms - ScannerThreadsSysTime: 19.866ms - ScannerThreadsUserTime: 162.832ms - ScannerThreadsVoluntaryContextSwitches: 3.38K (3385) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 10.666ms - TotalReadThroughput: 2.45 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 22.78 MB (23884231) - CumulativeAllocations: 8 (8) - PeakReservation: 22.50 MB (23592960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 22.50 MB (23592960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 42.666ms, non-child: 42.666ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 42.666ms - CodegenSysTime: 3.361ms - CodegenUserTime: 38.012ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 8.444ms - IrGenerationTime: 1.777ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 22 (22) - NumInstructions: 583 (583) - OptimizationTime: 19.555ms - PeakMemoryUsage: 291.50 KB (298496) - PrepareTime: 12.888ms Fragment F02: Instance 554562a26c33f0c6:2ec25d2f00000006 (host=impala-executor-000-7:22000):(Total: 8s003ms, non-child: 23.999ms, % non-child: 0.30%) Last report received time: 2019-11-21 22:56:07.476 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.95 MB Fragment Instance Lifecycle Event Timeline: 8s003ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 43.999ms (39.999ms) - First Batch Produced: 51.999ms (7.999ms) - First Batch Sent: 51.999ms (0.000ns) - ExecInternal Finished: 8s003ms (7s951ms) - MemoryUsage (500.000ms): 35.37 MB, 35.37 MB, 35.42 MB, 35.45 MB, 35.45 MB, 35.42 MB, 35.45 MB, 35.45 MB, 35.42 MB, 35.46 MB, 35.42 MB, 35.61 MB, 35.64 MB, 35.52 MB, 35.42 MB, 35.46 MB - ThreadUsage (500.000ms): 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 48.97 - PeakMemoryUsage: 35.77 MB (37511653) - PeakReservation: 30.38 MB (31850496) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1783833254) - RowsProduced: 4.73M (4728555) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s875ms - TotalStorageWaitTime: 7.999ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 31s743ms - TotalThreadsSysTime: 257.357ms - TotalThreadsUserTime: 1s092ms - TotalThreadsVoluntaryContextSwitches: 9.56K (9558) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 7s959ms - ExecTreeExecTime: 55.999ms - OpenTime: 39.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 3.999ms - ExecTreePrepareTime: 3.999ms KrpcDataStreamSender (dst_id=13):(Total: 7s879ms, non-child: 1s003ms, % non-child: 12.74%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.89 MB, 4.89 MB, 28.31 MB, 78.28 MB, 135.48 MB, 197.22 MB, 258.53 MB, 318.58 MB, 380.86 MB, 451.41 MB, 519.92 MB, 587.37 MB, 657.43 MB, 728.06 MB, 870.42 MB, 1.01 GB - NetworkThroughput: (Avg: 119.85 MB/sec ; Min: 2.70 MB/sec ; Max: 398.38 MB/sec ; Number of samples: 46200) - RpcNetworkTime: (Avg: 233.576us ; Min: 61.376us ; Max: 9.044ms ; Number of samples: 46210) - RpcRecvrTime: (Avg: 388.119us ; Min: 15.697us ; Max: 928.177ms ; Number of samples: 46210) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 4.73M (4728555) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 691.998ms - TotalBytesSent: 1.10 GB (1182826010) - UncompressedRowBatchSize: 2.46 GB (2646524140) HDFS_SCAN_NODE (id=4):(Total: 59.999ms, non-child: 59.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:3 Node Lifecycle Event Timeline: 8s003ms - Open Started: 43.999ms (43.999ms) - Open Finished: 43.999ms (0.000ns) - First Batch Requested: 43.999ms (0.000ns) - First Batch Returned: 51.999ms (7.999ms) - Last Batch Returned: 8s003ms (7s951ms) - Closed: 8s003ms (0.000ns) - BytesRead (500.000ms): 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 3) - PageIndexProcessingTime: (Avg: 2.666ms ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 3) - ParquetCompressedBytesReadPerColumn: (Avg: 7.39 MB (7744437) ; Min: 272.24 KB (278776) ; Max: 18.39 MB (19287584) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.53 KB (35362) ; Min: 4.43 KB (4540) ; Max: 64.14 KB (65683) ; Number of samples: 657) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetUncompressedBytesReadPerColumn: (Avg: 13.47 MB (14127251) ; Min: 420.11 KB (430197) ; Max: 36.51 MB (38284947) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.00 KB (64507) ; Min: 6.48 KB (6634) ; Max: 64.14 KB (65675) ; Number of samples: 657) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 23.03 MB (24152459) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 23.03 MB (24152459) - DataCacheHitCount: 15 (15) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 51.999ms - MaterializeTupleTime(*): 111.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 657 (657) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 35.70 MB (37429167) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 5.62 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 157.35 MB (164992806) - RowBatchQueueGetWaitTime: 7.999ms - RowBatchQueuePeakMemoryUsage: 3.74 MB (3919879) - RowBatchQueuePutWaitTime: 23s531ms - RowBatchesEnqueued: 4.62K (4623) - RowsRead: 4.88M (4875000) - RowsReturned: 4.73M (4728555) - RowsReturnedRate: 78.81 M/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 7.999ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 23s743ms - ScannerThreadsSysTime: 31.156ms - ScannerThreadsUserTime: 211.118ms - ScannerThreadsVoluntaryContextSwitches: 4.60K (4604) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 3.999ms - TotalReadThroughput: 2.88 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 30.75 MB (32243712) - CumulativeAllocations: 12 (12) - PeakReservation: 30.38 MB (31850496) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 30.38 MB (31850496) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 39.999ms, non-child: 39.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 39.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 40.003ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 7.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 22 (22) - NumInstructions: 583 (583) - OptimizationTime: 19.999ms - PeakMemoryUsage: 291.50 KB (298496) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f00000003 (host=impala-executor-000-9:22000):(Total: 8s000ms, non-child: 16.000ms, % non-child: 0.20%) Last report received time: 2019-11-21 22:56:07.475 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.94 MB Fragment Instance Lifecycle Event Timeline: 8s000ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 44.000ms (44.000ms) - First Batch Produced: 52.000ms (8.000ms) - First Batch Sent: 52.000ms (0.000ns) - ExecInternal Finished: 8s000ms (7s948ms) - MemoryUsage (500.000ms): 35.31 MB, 35.31 MB, 35.64 MB, 35.42 MB, 35.46 MB, 35.46 MB, 35.46 MB, 35.42 MB, 35.46 MB, 35.64 MB, 35.64 MB, 35.52 MB, 35.46 MB, 35.46 MB, 35.46 MB, 35.57 MB - ThreadUsage (500.000ms): 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 48.98 - PeakMemoryUsage: 35.77 MB (37511463) - PeakReservation: 30.38 MB (31850496) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785885642) - RowsProduced: 4.73M (4728722) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7s004ms - TotalStorageWaitTime: 12.000ms - TotalThreadsInvoluntaryContextSwitches: 67 (67) - TotalThreadsTotalWallClockTime: 31s708ms - TotalThreadsSysTime: 250.906ms - TotalThreadsUserTime: 1s071ms - TotalThreadsVoluntaryContextSwitches: 9.58K (9582) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 7s956ms - ExecTreeExecTime: 48.000ms - OpenTime: 44.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=13):(Total: 7s896ms, non-child: 892.006ms, % non-child: 11.30%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.35 MB, 4.35 MB, 42.10 MB, 93.64 MB, 152.79 MB, 210.42 MB, 271.03 MB, 333.80 MB, 397.71 MB, 466.20 MB, 536.31 MB, 606.17 MB, 671.93 MB, 742.96 MB, 912.43 MB, 1.05 GB - NetworkThroughput: (Avg: 116.89 MB/sec ; Min: 1.51 MB/sec ; Max: 378.62 MB/sec ; Number of samples: 46200) - RpcNetworkTime: (Avg: 239.063us ; Min: 54.641us ; Max: 16.178ms ; Number of samples: 46210) - RpcRecvrTime: (Avg: 352.733us ; Min: 15.444us ; Max: 920.579ms ; Number of samples: 46210) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 4.73M (4728722) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 576.004ms - TotalBytesSent: 1.10 GB (1182902490) - UncompressedRowBatchSize: 2.46 GB (2646612120) HDFS_SCAN_NODE (id=4):(Total: 44.000ms, non-child: 44.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.94 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:3 Node Lifecycle Event Timeline: 8s000ms - Open Started: 44.000ms (44.000ms) - Open Finished: 44.000ms (0.000ns) - First Batch Requested: 44.000ms (0.000ns) - First Batch Returned: 52.000ms (8.000ms) - Last Batch Returned: 7s996ms (7s944ms) - Closed: 8s000ms (4.000ms) - BytesRead (500.000ms): 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 3) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - ParquetCompressedBytesReadPerColumn: (Avg: 7.39 MB (7744267) ; Min: 272.14 KB (278668) ; Max: 18.39 MB (19287183) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.53 KB (35361) ; Min: 4.49 KB (4595) ; Max: 64.14 KB (65683) ; Number of samples: 657) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetUncompressedBytesReadPerColumn: (Avg: 13.47 MB (14127477) ; Min: 420.78 KB (430876) ; Max: 36.51 MB (38284947) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.00 KB (64509) ; Min: 6.55 KB (6708) ; Max: 64.14 KB (65675) ; Number of samples: 657) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 23.03 MB (24151393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 23.03 MB (24151393) - DataCacheHitCount: 15 (15) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 72.000ms - MaterializeTupleTime(*): 124.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 657 (657) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 35.70 MB (37428977) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 1.87 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 157.35 MB (164993485) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.74 MB (3919769) - RowBatchQueuePutWaitTime: 23s468ms - RowBatchesEnqueued: 4.62K (4623) - RowsRead: 4.88M (4875000) - RowsReturned: 4.73M (4728722) - RowsReturnedRate: 107.47 M/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 12.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 23s708ms - ScannerThreadsSysTime: 25.692ms - ScannerThreadsUserTime: 218.309ms - ScannerThreadsVoluntaryContextSwitches: 4.62K (4617) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 12.000ms - TotalReadThroughput: 2.88 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 30.75 MB (32243712) - CumulativeAllocations: 12 (12) - PeakReservation: 30.38 MB (31850496) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 30.38 MB (31850496) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 44.000ms, non-child: 44.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 44.000ms - CodegenSysTime: 15.134ms - CodegenUserTime: 26.430ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 8.000ms - IrGenerationTime: 4.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 22 (22) - NumInstructions: 583 (583) - OptimizationTime: 20.000ms - PeakMemoryUsage: 291.50 KB (298496) - PrepareTime: 12.000ms Instance 554562a26c33f0c6:2ec25d2f00000005 (host=impala-executor-000-0:22000):(Total: 7s979ms, non-child: 11.999ms, % non-child: 0.15%) Last report received time: 2019-11-21 22:56:07.480 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.95 MB Fragment Instance Lifecycle Event Timeline: 7s979ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 43.999ms (43.999ms) - First Batch Produced: 51.999ms (7.999ms) - First Batch Sent: 51.999ms (0.000ns) - ExecInternal Finished: 7s979ms (7s927ms) - MemoryUsage (500.000ms): 35.37 MB, 35.37 MB, 35.55 MB, 35.64 MB, 35.61 MB, 35.58 MB, 35.61 MB, 35.70 MB, 35.58 MB, 35.52 MB, 35.45 MB, 35.42 MB, 35.47 MB, 35.52 MB, 35.58 MB - ThreadUsage (500.000ms): 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4 - AverageThreadTokens: 4.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 48.98 - PeakMemoryUsage: 35.77 MB (37510121) - PeakReservation: 30.38 MB (31850496) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1787538877) - RowsProduced: 4.73M (4729442) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7s067ms - TotalStorageWaitTime: 19.999ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 31s619ms - TotalThreadsSysTime: 216.082ms - TotalThreadsUserTime: 1s082ms - TotalThreadsVoluntaryContextSwitches: 9.58K (9579) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 7s935ms - ExecTreeExecTime: 27.999ms - OpenTime: 43.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=13):(Total: 7s899ms, non-child: 831.997ms, % non-child: 10.53%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 3.42 MB, 3.64 MB, 55.41 MB, 110.40 MB, 170.49 MB, 227.63 MB, 289.68 MB, 352.02 MB, 417.20 MB, 486.63 MB, 557.42 MB, 625.57 MB, 693.48 MB, 790.61 MB, 965.40 MB - NetworkThroughput: (Avg: 114.25 MB/sec ; Min: 2.26 MB/sec ; Max: 388.32 MB/sec ; Number of samples: 46200) - RpcNetworkTime: (Avg: 248.964us ; Min: -248339.000ns ; Max: 10.759ms ; Number of samples: 46210) - RpcRecvrTime: (Avg: 301.000us ; Min: 13.704us ; Max: 927.849ms ; Number of samples: 46210) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 4.73M (4729442) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 603.998ms - TotalBytesSent: 1.10 GB (1183074040) - UncompressedRowBatchSize: 2.47 GB (2647028420) HDFS_SCAN_NODE (id=4):(Total: 23.999ms, non-child: 23.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:3 Node Lifecycle Event Timeline: 7s979ms - Open Started: 43.999ms (43.999ms) - Open Finished: 43.999ms (0.000ns) - First Batch Requested: 43.999ms (0.000ns) - First Batch Returned: 51.999ms (7.999ms) - Last Batch Returned: 7s979ms (7s927ms) - Closed: 7s979ms (0.000ns) - BytesRead (500.000ms): 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 3) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - ParquetCompressedBytesReadPerColumn: (Avg: 7.39 MB (7744696) ; Min: 271.31 KB (277818) ; Max: 18.40 MB (19289320) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.53 KB (35363) ; Min: 4.49 KB (4593) ; Max: 64.14 KB (65683) ; Number of samples: 657) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetUncompressedBytesReadPerColumn: (Avg: 13.47 MB (14126889) ; Min: 419.06 KB (429113) ; Max: 36.51 MB (38284947) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 62.99 KB (64506) ; Min: 6.47 KB (6625) ; Max: 64.14 KB (65675) ; Number of samples: 657) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 23.03 MB (24152709) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 23.03 MB (24152709) - DataCacheHitCount: 15 (15) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 31.999ms - MaterializeTupleTime(*): 135.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 657 (657) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 35.69 MB (37427635) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 719.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 157.35 MB (164991722) - RowBatchQueueGetWaitTime: 7.999ms - RowBatchQueuePeakMemoryUsage: 3.74 MB (3919319) - RowBatchQueuePutWaitTime: 23s423ms - RowBatchesEnqueued: 4.62K (4623) - RowsRead: 4.88M (4875000) - RowsReturned: 4.73M (4729442) - RowsReturnedRate: 197.06 M/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 19.999ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 23s639ms - ScannerThreadsSysTime: 49.302ms - ScannerThreadsUserTime: 188.718ms - ScannerThreadsVoluntaryContextSwitches: 4.60K (4603) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 31.999ms - TotalReadThroughput: 3.07 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 30.75 MB (32243712) - CumulativeAllocations: 12 (12) - PeakReservation: 30.38 MB (31850496) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 30.38 MB (31850496) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 43.999ms, non-child: 43.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 43.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 41.408ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 7.999ms - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 22 (22) - NumInstructions: 583 (583) - OptimizationTime: 19.999ms - PeakMemoryUsage: 291.50 KB (298496) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f0000000a (host=impala-executor-000-5:22000):(Total: 6s924ms, non-child: 24.000ms, % non-child: 0.35%) Last report received time: 2019-11-21 22:56:07.479 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/60.03 MB Fragment Instance Lifecycle Event Timeline: 6s924ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 44.000ms (44.000ms) - First Batch Produced: 52.001ms (8.000ms) - First Batch Sent: 52.001ms (0.000ns) - ExecInternal Finished: 6s924ms (6s872ms) - MemoryUsage (500.000ms): 24.73 MB, 24.73 MB, 24.86 MB, 24.76 MB, 24.86 MB, 24.76 MB, 24.92 MB, 24.76 MB, 24.89 MB, 24.88 MB, 24.76 MB, 24.86 MB, 24.89 MB, 10.47 MB - ThreadUsage (500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.86 - BloomFilterBytes: 0 - ExchangeScanRatio: 48.98 - PeakMemoryUsage: 25.01 MB (26222356) - PeakReservation: 20.25 MB (21233664) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1787087088) - RowsProduced: 3.16M (3155894) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s176ms - TotalStorageWaitTime: 8.000ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 20s440ms - TotalThreadsSysTime: 192.487ms - TotalThreadsUserTime: 724.474ms - TotalThreadsVoluntaryContextSwitches: 6.29K (6287) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s880ms - ExecTreeExecTime: 56.000ms - OpenTime: 44.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=13):(Total: 6s800ms, non-child: 624.007ms, % non-child: 9.18%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 3.66 MB, 3.66 MB, 38.38 MB, 90.19 MB, 149.02 MB, 206.23 MB, 267.29 MB, 330.08 MB, 392.38 MB, 462.97 MB, 532.79 MB, 600.29 MB, 668.20 MB, 739.78 MB - NetworkThroughput: (Avg: 118.27 MB/sec ; Min: 1.34 MB/sec ; Max: 378.37 MB/sec ; Number of samples: 30830) - RpcNetworkTime: (Avg: 239.890us ; Min: -108943.000ns ; Max: 18.231ms ; Number of samples: 30840) - RpcRecvrTime: (Avg: 532.404us ; Min: 13.573us ; Max: 928.339ms ; Number of samples: 30840) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 3.16M (3155894) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 440.005ms - TotalBytesSent: 752.90 MB (789472700) - UncompressedRowBatchSize: 1.65 GB (1766324240) HDFS_SCAN_NODE (id=4):(Total: 56.000ms, non-child: 56.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/60.03 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 6s924ms - Open Started: 44.000ms (44.000ms) - Open Finished: 44.000ms (0.000ns) - First Batch Requested: 44.000ms (0.000ns) - First Batch Returned: 52.001ms (8.000ms) - Last Batch Returned: 6s924ms (6s872ms) - Closed: 6s924ms (0.000ns) - BytesRead (500.000ms): 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 4.93 MB (5168422) ; Min: 181.45 KB (185805) ; Max: 12.28 MB (12872380) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.57 KB (35400) ; Min: 4.55 KB (4658) ; Max: 64.14 KB (65683) ; Number of samples: 438) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 8.99 MB (9427462) ; Min: 279.53 KB (286236) ; Max: 24.37 MB (25549298) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.06 KB (64571) ; Min: 6.63 KB (6790) ; Max: 64.14 KB (65675) ; Number of samples: 438) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.86 - BytesRead: 15.37 MB (16117718) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 15.37 MB (16117718) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 32.000ms - MaterializeTupleTime(*): 44.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 438 (438) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.93 MB (26139870) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 1.88 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 105.03 MB (110132258) - RowBatchQueueGetWaitTime: 8.000ms - RowBatchQueuePeakMemoryUsage: 3.62 MB (3799944) - RowBatchQueuePutWaitTime: 13s380ms - RowBatchesEnqueued: 3.09K (3086) - RowsRead: 3.25M (3253250) - RowsReturned: 3.16M (3155894) - RowsReturnedRate: 56.35 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 8.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 13s516ms - ScannerThreadsSysTime: 32.842ms - ScannerThreadsUserTime: 129.912ms - ScannerThreadsVoluntaryContextSwitches: 3.04K (3040) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 8.000ms - TotalReadThroughput: 2.20 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 20.50 MB (21495808) - CumulativeAllocations: 8 (8) - PeakReservation: 20.25 MB (21233664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 20.25 MB (21233664) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 44.000ms, non-child: 44.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 44.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 44.171ms - CodegenVoluntaryContextSwitches: 3 (3) - CompileTime: 8.000ms - IrGenerationTime: 4.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 22 (22) - NumInstructions: 583 (583) - OptimizationTime: 20.000ms - PeakMemoryUsage: 291.50 KB (298496) - PrepareTime: 12.000ms Instance 554562a26c33f0c6:2ec25d2f00000007 (host=impala-executor-000-6:22000):(Total: 6s919ms, non-child: 3.999ms, % non-child: 0.06%) Last report received time: 2019-11-21 22:56:07.477 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.85 MB Fragment Instance Lifecycle Event Timeline: 6s919ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 43.999ms (43.999ms) - First Batch Produced: 51.999ms (7.999ms) - First Batch Sent: 51.999ms (0.000ns) - ExecInternal Finished: 6s919ms (6s867ms) - MemoryUsage (500.000ms): 24.73 MB, 24.73 MB, 24.76 MB, 24.89 MB, 24.73 MB, 24.98 MB, 24.79 MB, 24.89 MB, 24.76 MB, 24.93 MB, 24.89 MB, 24.76 MB, 24.83 MB - ThreadUsage (500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 48.98 - PeakMemoryUsage: 24.98 MB (26189335) - PeakReservation: 20.25 MB (21233664) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1784251102) - RowsProduced: 3.15M (3146388) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s103ms - TotalStorageWaitTime: 7.999ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 20s407ms - TotalThreadsSysTime: 198.831ms - TotalThreadsUserTime: 749.660ms - TotalThreadsVoluntaryContextSwitches: 6.28K (6282) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s875ms - ExecTreeExecTime: 31.999ms - OpenTime: 43.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=13):(Total: 6s839ms, non-child: 735.997ms, % non-child: 10.76%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.74 MB, 5.01 MB, 49.42 MB, 104.87 MB, 164.78 MB, 224.58 MB, 283.20 MB, 345.54 MB, 414.36 MB, 478.88 MB, 549.22 MB, 619.82 MB, 685.06 MB - NetworkThroughput: (Avg: 112.54 MB/sec ; Min: 1.31 MB/sec ; Max: 379.45 MB/sec ; Number of samples: 30740) - RpcNetworkTime: (Avg: 252.681us ; Min: -351895.000ns ; Max: 18.576ms ; Number of samples: 30750) - RpcRecvrTime: (Avg: 503.401us ; Min: 14.006us ; Max: 927.717ms ; Number of samples: 30750) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 3.15M (3146388) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 463.998ms - TotalBytesSent: 750.61 MB (787068260) - UncompressedRowBatchSize: 1.64 GB (1761013720) HDFS_SCAN_NODE (id=4):(Total: 31.999ms, non-child: 31.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.85 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 6s919ms - Open Started: 43.999ms (43.999ms) - Open Finished: 43.999ms (0.000ns) - First Batch Requested: 43.999ms (0.000ns) - First Batch Returned: 51.999ms (7.999ms) - Last Batch Returned: 6s919ms (6s867ms) - Closed: 6s919ms (0.000ns) - BytesRead (500.000ms): 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB - FooterProcessingTime: (Avg: 1.999ms ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 4.91 MB (5152642) ; Min: 180.62 KB (184954) ; Max: 12.24 MB (12833222) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.46 KB (35292) ; Min: 2.73 KB (2799) ; Max: 64.14 KB (65683) ; Number of samples: 438) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 8.96 MB (9398705) ; Min: 278.61 KB (285295) ; Max: 24.29 MB (25471298) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 62.87 KB (64374) ; Min: 5.43 KB (5559) ; Max: 64.14 KB (65675) ; Number of samples: 438) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 15.33 MB (16070185) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 15.33 MB (16070185) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 39.999ms - MaterializeTupleTime(*): 87.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 438 (438) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.90 MB (26106849) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 3.74 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.70 MB (109786065) - RowBatchQueueGetWaitTime: 7.999ms - RowBatchQueuePeakMemoryUsage: 3.59 MB (3766365) - RowBatchQueuePutWaitTime: 13s323ms - RowBatchesEnqueued: 3.08K (3076) - RowsRead: 3.24M (3243500) - RowsReturned: 3.15M (3146388) - RowsReturnedRate: 98.33 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 7.999ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 13s487ms - ScannerThreadsSysTime: 4.045ms - ScannerThreadsUserTime: 165.312ms - ScannerThreadsVoluntaryContextSwitches: 3.03K (3030) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 3.999ms - TotalReadThroughput: 2.36 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 20.50 MB (21495808) - CumulativeAllocations: 8 (8) - PeakReservation: 20.25 MB (21233664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 20.25 MB (21233664) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 43.999ms, non-child: 43.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 43.999ms - CodegenSysTime: 7.465ms - CodegenUserTime: 33.594ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 7.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 22 (22) - NumInstructions: 583 (583) - OptimizationTime: 19.999ms - PeakMemoryUsage: 291.50 KB (298496) - PrepareTime: 15.999ms Instance 554562a26c33f0c6:2ec25d2f00000004 (host=impala-executor-000-2:22000):(Total: 6s912ms, non-child: 36.000ms, % non-child: 0.52%) Last report received time: 2019-11-21 22:56:07.479 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.96 MB Fragment Instance Lifecycle Event Timeline: 6s912ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 44.000ms (44.000ms) - First Batch Produced: 48.000ms (4.000ms) - First Batch Sent: 52.000ms (4.000ms) - ExecInternal Finished: 6s912ms (6s860ms) - MemoryUsage (500.000ms): 24.73 MB, 24.73 MB, 24.73 MB, 24.73 MB, 24.89 MB, 24.76 MB, 24.89 MB, 24.76 MB, 24.76 MB, 24.94 MB, 24.76 MB, 24.76 MB, 24.86 MB, 8.14 MB - ThreadUsage (500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.86 - BloomFilterBytes: 0 - ExchangeScanRatio: 48.99 - PeakMemoryUsage: 24.98 MB (26189463) - PeakReservation: 20.25 MB (21233664) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785995032) - RowsProduced: 3.15M (3152814) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s116ms - TotalStorageWaitTime: 8.000ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 20s380ms - TotalThreadsSysTime: 145.168ms - TotalThreadsUserTime: 787.508ms - TotalThreadsVoluntaryContextSwitches: 6.31K (6313) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s868ms - ExecTreeExecTime: 36.000ms - OpenTime: 44.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=13):(Total: 6s800ms, non-child: 684.000ms, % non-child: 10.06%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 3.59 MB, 3.59 MB, 41.75 MB, 97.69 MB, 155.28 MB, 217.63 MB, 278.95 MB, 338.06 MB, 404.02 MB, 475.15 MB, 542.05 MB, 610.49 MB, 680.56 MB, 752.10 MB - NetworkThroughput: (Avg: 113.62 MB/sec ; Min: 743.12 KB/sec ; Max: 366.56 MB/sec ; Number of samples: 30800) - RpcNetworkTime: (Avg: 252.167us ; Min: -2084521.000ns ; Max: 33.666ms ; Number of samples: 30810) - RpcRecvrTime: (Avg: 475.693us ; Min: 13.262us ; Max: 891.304ms ; Number of samples: 30810) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 3.15M (3152814) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 476.000ms - TotalBytesSent: 752.14 MB (788678610) - UncompressedRowBatchSize: 1.64 GB (1764597560) HDFS_SCAN_NODE (id=4):(Total: 32.000ms, non-child: 32.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 6s912ms - Open Started: 44.000ms (44.000ms) - Open Finished: 44.000ms (0.000ns) - First Batch Requested: 44.000ms (0.000ns) - First Batch Returned: 48.000ms (4.000ms) - Last Batch Returned: 6s904ms (6s856ms) - Closed: 6s912ms (8.000ms) - BytesRead (500.000ms): 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 4.92 MB (5162627) ; Min: 180.79 KB (185127) ; Max: 12.26 MB (12858114) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.53 KB (35360) ; Min: 2.73 KB (2799) ; Max: 64.14 KB (65683) ; Number of samples: 438) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 8.98 MB (9418088) ; Min: 279.84 KB (286556) ; Max: 24.34 MB (25523298) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.00 KB (64507) ; Min: 5.43 KB (5559) ; Max: 64.14 KB (65675) ; Number of samples: 438) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.86 - BytesRead: 15.35 MB (16100206) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 15.35 MB (16100206) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 44.000ms - MaterializeTupleTime(*): 128.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 438 (438) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.90 MB (26106977) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 1.87 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.93 MB (110028760) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.59 MB (3766179) - RowBatchQueuePutWaitTime: 13s264ms - RowBatchesEnqueued: 3.08K (3083) - RowsRead: 3.25M (3250000) - RowsReturned: 3.15M (3152814) - RowsReturnedRate: 98.53 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 8.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 13s468ms - ScannerThreadsSysTime: 13.419ms - ScannerThreadsUserTime: 159.803ms - ScannerThreadsVoluntaryContextSwitches: 3.05K (3046) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 8.000ms - TotalReadThroughput: 2.19 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 20.50 MB (21495808) - CumulativeAllocations: 8 (8) - PeakReservation: 20.25 MB (21233664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 20.25 MB (21233664) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 44.000ms, non-child: 44.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 44.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 43.588ms - CodegenVoluntaryContextSwitches: 6 (6) - CompileTime: 8.000ms - IrGenerationTime: 4.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 22 (22) - NumInstructions: 583 (583) - OptimizationTime: 20.000ms - PeakMemoryUsage: 291.50 KB (298496) - PrepareTime: 12.000ms Instance 554562a26c33f0c6:2ec25d2f00000009 (host=impala-executor-000-3:22000):(Total: 6s903ms, non-child: 15.999ms, % non-child: 0.23%) Last report received time: 2019-11-21 22:56:07.478 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.97 MB Fragment Instance Lifecycle Event Timeline: 6s907ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 43.999ms (39.999ms) - First Batch Produced: 47.999ms (3.999ms) - First Batch Sent: 47.999ms (0.000ns) - ExecInternal Finished: 6s907ms (6s859ms) - MemoryUsage (500.000ms): 24.73 MB, 24.73 MB, 24.86 MB, 24.73 MB, 24.86 MB, 24.76 MB, 24.92 MB, 24.73 MB, 24.89 MB, 24.85 MB, 24.79 MB, 24.92 MB, 24.86 MB, 24.18 MB - ThreadUsage (500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 48.97 - PeakMemoryUsage: 25.01 MB (26223690) - PeakReservation: 20.25 MB (21233664) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1781773442) - RowsProduced: 3.15M (3152249) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s119ms - TotalStorageWaitTime: 7.999ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 20s379ms - TotalThreadsSysTime: 148.446ms - TotalThreadsUserTime: 750.618ms - TotalThreadsVoluntaryContextSwitches: 6.31K (6309) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s863ms - ExecTreeExecTime: 19.999ms - OpenTime: 39.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=13):(Total: 6s831ms, non-child: 711.999ms, % non-child: 10.42%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 6.84 MB, 6.84 MB, 34.54 MB, 85.16 MB, 144.74 MB, 206.81 MB, 266.13 MB, 324.75 MB, 390.88 MB, 458.83 MB, 524.81 MB, 595.89 MB, 665.76 MB, 731.47 MB - NetworkThroughput: (Avg: 112.35 MB/sec ; Min: 1.70 MB/sec ; Max: 393.02 MB/sec ; Number of samples: 30800) - RpcNetworkTime: (Avg: 257.803us ; Min: -18062219.000ns ; Max: 14.363ms ; Number of samples: 30810) - RpcRecvrTime: (Avg: 531.610us ; Min: 14.970us ; Max: 928.250ms ; Number of samples: 30810) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 3.15M (3152249) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 479.999ms - TotalBytesSent: 751.98 MB (788510250) - UncompressedRowBatchSize: 1.64 GB (1764281680) HDFS_SCAN_NODE (id=4):(Total: 15.999ms, non-child: 15.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 6s907ms - Open Started: 43.999ms (43.999ms) - Open Finished: 43.999ms (0.000ns) - First Batch Requested: 43.999ms (0.000ns) - First Batch Returned: 47.999ms (3.999ms) - Last Batch Returned: 6s887ms (6s839ms) - Closed: 6s907ms (19.999ms) - BytesRead (500.000ms): 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 4.92 MB (5163524) ; Min: 181.81 KB (186170) ; Max: 12.26 MB (12859770) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.54 KB (35366) ; Min: 4.47 KB (4580) ; Max: 64.14 KB (65683) ; Number of samples: 438) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 8.98 MB (9418190) ; Min: 280.14 KB (286866) ; Max: 24.34 MB (25523298) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.00 KB (64508) ; Min: 6.49 KB (6644) ; Max: 64.14 KB (65675) ; Number of samples: 438) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 15.36 MB (16102970) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 15.36 MB (16102970) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 47.999ms - MaterializeTupleTime(*): 99.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 438 (438) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.93 MB (26141204) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 1.87 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.90 MB (109995272) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 3.62 MB (3800371) - RowBatchQueuePutWaitTime: 13s287ms - RowBatchesEnqueued: 3.08K (3082) - RowsRead: 3.25M (3250000) - RowsReturned: 3.15M (3152249) - RowsReturnedRate: 197.02 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 7.999ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 13s475ms - ScannerThreadsSysTime: 6.525ms - ScannerThreadsUserTime: 149.321ms - ScannerThreadsVoluntaryContextSwitches: 3.03K (3032) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 7.999ms - TotalReadThroughput: 2.19 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 20.50 MB (21495808) - CumulativeAllocations: 8 (8) - PeakReservation: 20.25 MB (21233664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 20.25 MB (21233664) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 39.999ms, non-child: 39.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 39.999ms - CodegenSysTime: 3.997ms - CodegenUserTime: 35.974ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 7.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 22 (22) - NumInstructions: 583 (583) - OptimizationTime: 19.999ms - PeakMemoryUsage: 291.50 KB (298496) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f00000008 (host=impala-executor-000-1:22000):(Total: 6s799ms, non-child: 15.999ms, % non-child: 0.24%) Last report received time: 2019-11-21 22:56:07.474 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/60.03 MB Fragment Instance Lifecycle Event Timeline: 6s799ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 44.000ms (44.000ms) - First Batch Produced: 52.000ms (8.000ms) - First Batch Sent: 52.000ms (0.000ns) - ExecInternal Finished: 6s799ms (6s747ms) - MemoryUsage (500.000ms): 24.73 MB, 24.73 MB, 24.73 MB, 24.89 MB, 24.76 MB, 24.98 MB, 24.73 MB, 24.86 MB, 24.86 MB, 24.76 MB, 24.73 MB, 24.86 MB, 24.86 MB - ThreadUsage (500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 48.98 - PeakMemoryUsage: 24.98 MB (26189207) - PeakReservation: 20.25 MB (21233664) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785404996) - RowsProduced: 3.16M (3155870) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s023ms - TotalStorageWaitTime: 8.000ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 20s019ms - TotalThreadsSysTime: 170.028ms - TotalThreadsUserTime: 773.011ms - TotalThreadsVoluntaryContextSwitches: 6.31K (6311) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s755ms - ExecTreeExecTime: 31.999ms - OpenTime: 44.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=13):(Total: 6s707ms, non-child: 683.998ms, % non-child: 10.20%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 5.62 MB, 5.93 MB, 52.57 MB, 109.48 MB, 171.31 MB, 233.56 MB, 293.69 MB, 356.96 MB, 427.29 MB, 494.47 MB, 567.02 MB, 639.26 MB, 706.02 MB - NetworkThroughput: (Avg: 112.38 MB/sec ; Min: 2.19 MB/sec ; Max: 360.47 MB/sec ; Number of samples: 30830) - RpcNetworkTime: (Avg: 261.070us ; Min: -1005899.000ns ; Max: 11.188ms ; Number of samples: 30840) - RpcRecvrTime: (Avg: 541.396us ; Min: 13.588us ; Max: 928.003ms ; Number of samples: 30840) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 3.16M (3155870) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 399.998ms - TotalBytesSent: 752.85 MB (789417320) - UncompressedRowBatchSize: 1.65 GB (1766313160) HDFS_SCAN_NODE (id=4):(Total: 31.999ms, non-child: 31.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/60.03 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 6s799ms - Open Started: 44.000ms (44.000ms) - Open Finished: 44.000ms (0.000ns) - First Batch Requested: 44.000ms (0.000ns) - First Batch Returned: 52.000ms (8.000ms) - Last Batch Returned: 6s795ms (6s743ms) - Closed: 6s799ms (3.999ms) - BytesRead (500.000ms): 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 4.93 MB (5167971) ; Min: 181.33 KB (185683) ; Max: 12.27 MB (12871150) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.57 KB (35397) ; Min: 4.67 KB (4787) ; Max: 64.14 KB (65683) ; Number of samples: 438) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 8.99 MB (9427658) ; Min: 280.10 KB (286824) ; Max: 24.37 MB (25549298) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.06 KB (64573) ; Min: 6.69 KB (6847) ; Max: 64.14 KB (65675) ; Number of samples: 438) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 15.37 MB (16116354) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 15.37 MB (16116354) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 31.999ms - MaterializeTupleTime(*): 63.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 438 (438) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.90 MB (26106721) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 960.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 105.03 MB (110132846) - RowBatchQueueGetWaitTime: 8.000ms - RowBatchQueuePeakMemoryUsage: 3.59 MB (3766094) - RowBatchQueuePutWaitTime: 13s071ms - RowBatchesEnqueued: 3.09K (3086) - RowsRead: 3.25M (3253250) - RowsReturned: 3.16M (3155870) - RowsReturnedRate: 98.62 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 8.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 13s219ms - ScannerThreadsSysTime: 10.260ms - ScannerThreadsUserTime: 165.232ms - ScannerThreadsVoluntaryContextSwitches: 3.03K (3032) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 16.000ms - TotalReadThroughput: 2.36 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 20.50 MB (21495808) - CumulativeAllocations: 8 (8) - PeakReservation: 20.25 MB (21233664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 20.25 MB (21233664) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 44.000ms, non-child: 44.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 44.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 40.593ms - CodegenVoluntaryContextSwitches: 5 (5) - CompileTime: 8.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 22 (22) - NumInstructions: 583 (583) - OptimizationTime: 20.000ms - PeakMemoryUsage: 291.50 KB (298496) - PrepareTime: 16.000ms Instance 554562a26c33f0c6:2ec25d2f00000002 (host=impala-executor-000-4:22000):(Total: 4s152ms, non-child: 20.000ms, % non-child: 0.48%) Last report received time: 2019-11-21 22:56:02.470 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/29.99 MB Fragment Instance Lifecycle Event Timeline: 4s152ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 44.000ms (40.000ms) - First Batch Produced: 48.000ms (4.000ms) - First Batch Sent: 48.000ms (0.000ns) - ExecInternal Finished: 4s152ms (4s104ms) - MemoryUsage (500.000ms): 14.14 MB, 14.14 MB, 14.14 MB, 14.14 MB, 14.10 MB, 14.10 MB, 14.14 MB, 14.10 MB - ThreadUsage (500.000ms): 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 48.96 - PeakMemoryUsage: 14.24 MB (14933848) - PeakReservation: 10.12 MB (10616832) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1786101518) - RowsProduced: 1.58M (1575896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s748ms - TotalStorageWaitTime: 4.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 8s104ms - TotalThreadsSysTime: 94.667ms - TotalThreadsUserTime: 389.481ms - TotalThreadsVoluntaryContextSwitches: 3.21K (3210) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 4s108ms - ExecTreeExecTime: 20.000ms - OpenTime: 40.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 4.000ms - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=13):(Total: 4s076ms, non-child: 328.001ms, % non-child: 8.05%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 7.35 MB, 7.35 MB, 34.94 MB, 84.04 MB, 142.67 MB, 204.51 MB, 265.55 MB, 322.95 MB - NetworkThroughput: (Avg: 109.99 MB/sec ; Min: 1.28 MB/sec ; Max: 454.47 MB/sec ; Number of samples: 15390) - RpcNetworkTime: (Avg: 275.959us ; Min: -969730.000ns ; Max: 19.036ms ; Number of samples: 15400) - RpcRecvrTime: (Avg: 844.612us ; Min: 15.336us ; Max: 927.562ms ; Number of samples: 15400) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 1.58M (1575896) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 192.000ms - TotalBytesSent: 375.95 MB (394216660) - UncompressedRowBatchSize: 841.15 MB (882014320) HDFS_SCAN_NODE (id=4):(Total: 16.000ms, non-child: 16.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/29.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 4s152ms - Open Started: 44.000ms (44.000ms) - Open Finished: 44.000ms (0.000ns) - First Batch Requested: 44.000ms (0.000ns) - First Batch Returned: 48.000ms (4.000ms) - Last Batch Returned: 4s148ms (4s100ms) - Closed: 4s152ms (4.000ms) - BytesRead (500.000ms): 7.68 MB, 7.68 MB, 7.68 MB, 7.68 MB, 7.68 MB, 7.68 MB, 7.68 MB, 7.68 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - ParquetCompressedBytesReadPerColumn: (Avg: 2.46 MB (2581822) ; Min: 91.30 KB (93490) ; Max: 6.13 MB (6429659) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.54 KB (35367) ; Min: 4.64 KB (4751) ; Max: 64.14 KB (65683) ; Number of samples: 219) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 4.49 MB (4709205) ; Min: 140.39 KB (143764) ; Max: 12.17 MB (12761649) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.00 KB (64509) ; Min: 6.69 KB (6855) ; Max: 64.14 KB (65675) ; Number of samples: 219) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 7.68 MB (8051666) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 5 (5) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 7.68 MB (8051666) - DataCacheHitCount: 5 (5) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 40.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 219 (219) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 14.10 MB (14785852) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 1.87 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 52.45 MB (54997967) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.49 MB (3663017) - RowBatchQueuePutWaitTime: 3s888ms - RowBatchesEnqueued: 1.54K (1541) - RowsRead: 1.62M (1625000) - RowsReturned: 1.58M (1575896) - RowsReturnedRate: 98.49 M/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 4.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 3s956ms - ScannerThreadsSysTime: 5.555ms - ScannerThreadsUserTime: 77.770ms - ScannerThreadsVoluntaryContextSwitches: 1.46K (1464) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 4.000ms - TotalReadThroughput: 1.92 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 10.25 MB (10747904) - CumulativeAllocations: 4 (4) - PeakReservation: 10.12 MB (10616832) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 10.12 MB (10616832) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 40.000ms, non-child: 40.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 40.000ms - CodegenSysTime: 3.653ms - CodegenUserTime: 36.349ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 12.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 22 (22) - NumInstructions: 583 (583) - OptimizationTime: 16.000ms - PeakMemoryUsage: 291.50 KB (298496) - PrepareTime: 12.000ms Averaged Fragment F03:(Total: 1s304ms, non-child: 4.000ms, % non-child: 0.31%) split sizes: min: 470.66 KB, max: 1.38 MB, avg: 942.65 KB, stddev: 210.85 KB completion times: min:5s012ms max:5s016ms mean: 5s012ms stddev:1.600ms execution rates: min:93.91 KB/sec max:282.04 KB/sec mean:188.05 KB/sec stddev:42.07 KB/sec num instances: 10 - AverageThreadTokens: 2.83 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.37 - PeakMemoryUsage: 5.28 MB (5531637) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785310845) - RowsProduced: 192.08K (192080) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s230ms - TotalStorageWaitTime: 800.007us - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 3s547ms - TotalThreadsSysTime: 10.468ms - TotalThreadsUserTime: 76.889ms - TotalThreadsVoluntaryContextSwitches: 483 (483) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s280ms - ExecTreeExecTime: 4.800ms - OpenTime: 22.400ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 1.199ms - ExecTreePrepareTime: 399.999us KrpcDataStreamSender (dst_id=14):(Total: 1s272ms, non-child: 1s272ms, % non-child: 100.00%) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.08K (192080) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 32.000ms - TotalBytesSent: 43.22 MB (45319091) - UncompressedRowBatchSize: 94.47 MB (99058400) HDFS_SCAN_NODE (id=2):(Total: 5.600ms, non-child: 5.600ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.83 - BytesRead: 1.10 MB (1151047) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151047) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 2.000ms - MaterializeTupleTime(*): 5.200ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5480114) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 68.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6478620) - RowBatchQueueGetWaitTime: 3.600ms - RowBatchQueuePeakMemoryUsage: 3.35 MB (3513705) - RowBatchQueuePutWaitTime: 2s221ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.08K (192080) - RowsReturned: 192.08K (192080) - RowsReturnedRate: 38.42 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 800.007us - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s244ms - ScannerThreadsSysTime: 1.810ms - ScannerThreadsUserTime: 10.709ms - ScannerThreadsVoluntaryContextSwitches: 131 (131) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 800.007us - TotalReadThroughput: 1.01 MB/sec Buffer pool: - AllocTime: 399.997us - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 22.400ms, non-child: 22.400ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 22.400ms - CodegenSysTime: 1.176ms - CodegenUserTime: 20.559ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 4.000ms - IrGenerationTime: 800.001us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.400ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 13.200ms Fragment F03: Instance 554562a26c33f0c6:2ec25d2f0000000d (host=impala-executor-000-7:22000):(Total: 1s371ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:56:02.473 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/1.38 MB Fragment Instance Lifecycle Event Timeline: 1s371ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 23.999ms (19.999ms) - First Batch Produced: 27.999ms (3.999ms) - First Batch Sent: 27.999ms (0.000ns) - ExecInternal Finished: 1s371ms (1s343ms) - MemoryUsage (500.000ms): 6.21 MB, 6.21 MB, 6.26 MB - ThreadUsage (500.000ms): 4, 4, 4 - AverageThreadTokens: 4.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.36 - PeakMemoryUsage: 6.27 MB (6574116) - PeakReservation: 1.55 MB (1622016) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1783833254) - RowsProduced: 287.93K (287927) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s275ms - TotalStorageWaitTime: 3.999ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 5s303ms - TotalThreadsSysTime: 18.361ms - TotalThreadsUserTime: 97.652ms - TotalThreadsVoluntaryContextSwitches: 786 (786) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s347ms - ExecTreeExecTime: 3.999ms - OpenTime: 19.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 3.999ms - ExecTreePrepareTime: 3.999ms KrpcDataStreamSender (dst_id=14):(Total: 1s339ms, non-child: 63.999ms, % non-child: 4.78%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 5.42 MB, 5.42 MB, 31.75 MB - NetworkThroughput: (Avg: 95.12 MB/sec ; Min: 2.57 MB/sec ; Max: 350.25 MB/sec ; Number of samples: 2820) - RpcNetworkTime: (Avg: 366.276us ; Min: 3.190us ; Max: 8.977ms ; Number of samples: 2830) - RpcRecvrTime: (Avg: 2.779ms ; Min: 19.059us ; Max: 944.500ms ; Number of samples: 2830) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 287.93K (287927) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 43.999ms - TotalBytesSent: 64.78 MB (67924340) - UncompressedRowBatchSize: 141.62 MB (148499690) HDFS_SCAN_NODE (id=2):(Total: 11.999ms, non-child: 11.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/1.38 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:3 Node Lifecycle Event Timeline: 1s371ms - Open Started: 23.999ms (23.999ms) - Open Finished: 23.999ms (0.000ns) - First Batch Requested: 23.999ms (0.000ns) - First Batch Returned: 27.999ms (3.999ms) - Last Batch Returned: 1s371ms (1s343ms) - Closed: 1s371ms (0.000ns) - BytesRead (500.000ms): 1.65 MB, 1.65 MB, 1.65 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 3) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 304.54 KB (311849) ; Min: 9.14 KB (9362) ; Max: 893.55 KB (914997) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.68 KB (28349) ; Min: 2.96 KB (3027) ; Max: 64.14 KB (65683) ; Number of samples: 33) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 3) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 3) - ParquetUncompressedBytesReadPerColumn: (Avg: 571.28 KB (584986) ; Min: 61.05 KB (62511) ; Max: 1.51 MB (1583875) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.93 KB (53180) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 33) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 1.65 MB (1725851) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 12 (12) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.65 MB (1725851) - DataCacheHitCount: 12 (12) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 33 (33) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.22 MB (6525972) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 411.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 9.26 MB (9712716) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 3.38 MB (3541840) - RowBatchQueuePutWaitTime: 3s915ms - RowBatchesEnqueued: 288 (288) - RowsRead: 287.93K (287927) - RowsReturned: 287.93K (287927) - RowsReturnedRate: 23.99 M/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 3.999ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3s935ms - ScannerThreadsSysTime: 6.125ms - ScannerThreadsUserTime: 12.173ms - ScannerThreadsVoluntaryContextSwitches: 241 (241) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 3.999ms - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.92 MB (2015232) - CumulativeAllocations: 12 (12) - PeakReservation: 1.55 MB (1622016) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.55 MB (1622016) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 19.999ms, non-child: 19.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 19.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 20.003ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 3.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 3.999ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f0000000c (host=impala-executor-000-1:22000):(Total: 1s335ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:56:02.471 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/943.35 KB Fragment Instance Lifecycle Event Timeline: 1s335ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 28.000ms (4.000ms) - First Batch Sent: 28.000ms (0.000ns) - ExecInternal Finished: 1s335ms (1s307ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.38 - PeakMemoryUsage: 5.28 MB (5532598) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785404996) - RowsProduced: 192.27K (192272) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s263ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 3s683ms - TotalThreadsSysTime: 11.062ms - TotalThreadsUserTime: 77.917ms - TotalThreadsVoluntaryContextSwitches: 500 (500) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s311ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s307ms, non-child: 43.999ms, % non-child: 3.36%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 3.41 MB, 3.62 MB - NetworkThroughput: (Avg: 84.86 MB/sec ; Min: 2.10 MB/sec ; Max: 328.78 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 458.205us ; Min: -334312.000ns ; Max: 10.946ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 5.068ms ; Min: 14.647us ; Max: 944.355ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.27K (192272) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 31.999ms - TotalBytesSent: 43.25 MB (45353210) - UncompressedRowBatchSize: 94.57 MB (99164080) HDFS_SCAN_NODE (id=2):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/943.35 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s335ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 28.000ms (4.000ms) - Last Batch Returned: 1s331ms (1s303ms) - Closed: 1s335ms (3.999ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.42 KB (208301) ; Min: 6.10 KB (6244) ; Max: 596.96 KB (611289) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.74 KB (28404) ; Min: 3.01 KB (3085) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.76 KB (390925) ; Min: 40.81 KB (41792) ; Max: 1.01 MB (1058482) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 52.06 KB (53308) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1151786) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151786) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8.000ms - MaterializeTupleTime(*): 19.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484454) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475382) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3499787) - RowBatchQueuePutWaitTime: 2s311ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.27K (192272) - RowsReturned: 192.27K (192272) - RowsReturnedRate: 48.07 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 2s347ms - ScannerThreadsSysTime: 2.070ms - ScannerThreadsUserTime: 10.518ms - ScannerThreadsVoluntaryContextSwitches: 137 (137) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 24.086ms - CodegenVoluntaryContextSwitches: 5 (5) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms Instance 554562a26c33f0c6:2ec25d2f0000000b (host=impala-executor-000-6:22000):(Total: 1s335ms, non-child: 3.999ms, % non-child: 0.30%) Last report received time: 2019-11-21 22:56:02.474 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/943.33 KB Fragment Instance Lifecycle Event Timeline: 1s335ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 23.999ms (23.999ms) - First Batch Produced: 27.999ms (3.999ms) - First Batch Sent: 27.999ms (0.000ns) - ExecInternal Finished: 1s335ms (1s307ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.40 - PeakMemoryUsage: 5.28 MB (5532608) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1784251102) - RowsProduced: 192.27K (192274) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s271ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 3s687ms - TotalThreadsSysTime: 8.237ms - TotalThreadsUserTime: 79.870ms - TotalThreadsVoluntaryContextSwitches: 448 (448) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s311ms - ExecTreeExecTime: 3.999ms - OpenTime: 23.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s303ms, non-child: 31.999ms, % non-child: 2.45%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.86 MB, 5.27 MB - NetworkThroughput: (Avg: 83.00 MB/sec ; Min: 879.82 KB/sec ; Max: 311.68 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 399.587us ; Min: -1147236.000ns ; Max: 26.772ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 5.058ms ; Min: 13.444us ; Max: 944.585ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.27K (192274) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 27.999ms - TotalBytesSent: 43.28 MB (45379990) - UncompressedRowBatchSize: 94.58 MB (99172680) HDFS_SCAN_NODE (id=2):(Total: 3.999ms, non-child: 3.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/943.33 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s335ms - Open Started: 23.999ms (23.999ms) - Open Finished: 23.999ms (0.000ns) - First Batch Requested: 23.999ms (0.000ns) - First Batch Returned: 27.999ms (3.999ms) - Last Batch Returned: 1s331ms (1s303ms) - Closed: 1s335ms (3.999ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.45 KB (208337) ; Min: 6.08 KB (6223) ; Max: 596.96 KB (611284) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.74 KB (28409) ; Min: 3.01 KB (3084) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.77 KB (390934) ; Min: 40.82 KB (41796) ; Max: 1.01 MB (1058498) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 52.06 KB (53309) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1151871) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151871) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 3.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484464) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475392) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3499929) - RowBatchQueuePutWaitTime: 2s339ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.27K (192274) - RowsReturned: 192.27K (192274) - RowsReturnedRate: 48.07 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s351ms - ScannerThreadsSysTime: 3.181ms - ScannerThreadsUserTime: 9.078ms - ScannerThreadsVoluntaryContextSwitches: 129 (129) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 3.999ms - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 23.999ms, non-child: 23.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 23.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 20.992ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 3.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 3.999ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 15.999ms Instance 554562a26c33f0c6:2ec25d2f00000014 (host=impala-executor-000-5:22000):(Total: 1s332ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:56:02.476 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.84 KB Fragment Instance Lifecycle Event Timeline: 1s332ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 28.000ms (4.000ms) - First Batch Sent: 28.000ms (0.000ns) - ExecInternal Finished: 1s332ms (1s304ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.38 - PeakMemoryUsage: 5.28 MB (5532389) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1787087088) - RowsProduced: 192.08K (192083) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s264ms - TotalStorageWaitTime: 4.000ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 3s672ms - TotalThreadsSysTime: 4.547ms - TotalThreadsUserTime: 81.997ms - TotalThreadsVoluntaryContextSwitches: 475 (475) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s308ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s304ms, non-child: 40.000ms, % non-child: 3.07%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 3.52 MB, 3.52 MB - NetworkThroughput: (Avg: 87.52 MB/sec ; Min: 1.26 MB/sec ; Max: 351.67 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 445.297us ; Min: -37609.000ns ; Max: 18.210ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 5.051ms ; Min: 12.795us ; Max: 944.570ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.08K (192083) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 36.000ms - TotalBytesSent: 43.23 MB (45329680) - UncompressedRowBatchSize: 94.46 MB (99050110) HDFS_SCAN_NODE (id=2):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.84 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s332ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 28.000ms (4.000ms) - Last Batch Returned: 1s332ms (1s304ms) - Closed: 1s332ms (0.000ns) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.22 KB (208098) ; Min: 6.09 KB (6234) ; Max: 596.25 KB (610563) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.71 KB (28377) ; Min: 3.00 KB (3069) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.20 KB (390351) ; Min: 40.67 KB (41649) ; Max: 1.01 MB (1056970) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.98 KB (53229) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1151140) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151140) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - MaterializeTupleTime(*): 4.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484245) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 274.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475173) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3499833) - RowBatchQueuePutWaitTime: 2s324ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.08K (192083) - RowsReturned: 192.08K (192083) - RowsReturnedRate: 48.02 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 4.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s340ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 13.841ms - ScannerThreadsVoluntaryContextSwitches: 138 (138) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 4.000ms - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 4.184ms - CodegenUserTime: 20.870ms - CodegenVoluntaryContextSwitches: 3 (3) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms Instance 554562a26c33f0c6:2ec25d2f0000000f (host=impala-executor-000-4:22000):(Total: 1s332ms, non-child: 4.000ms, % non-child: 0.30%) Last report received time: 2019-11-21 22:56:02.471 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.47 KB Fragment Instance Lifecycle Event Timeline: 1s332ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 24.000ms (20.000ms) - First Batch Produced: 28.000ms (4.000ms) - First Batch Sent: 28.000ms (0.000ns) - ExecInternal Finished: 1s332ms (1s304ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB, 2.01 MB - ThreadUsage (500.000ms): 3, 3, 1 - AverageThreadTokens: 2.33 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.37 - PeakMemoryUsage: 5.28 MB (5532476) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1786101518) - RowsProduced: 192.08K (192079) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s240ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 3s656ms - TotalThreadsSysTime: 9.510ms - TotalThreadsUserTime: 74.631ms - TotalThreadsVoluntaryContextSwitches: 478 (478) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s308ms - ExecTreeExecTime: 4.000ms - OpenTime: 20.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 4.000ms - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s304ms, non-child: 64.000ms, % non-child: 4.91%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.15 MB, 4.15 MB, 35.72 MB - NetworkThroughput: (Avg: 87.85 MB/sec ; Min: 1.17 MB/sec ; Max: 380.63 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 421.495us ; Min: -297132.000ns ; Max: 19.748ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 5.047ms ; Min: 13.599us ; Max: 944.524ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.08K (192079) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 52.000ms - TotalBytesSent: 43.22 MB (45318520) - UncompressedRowBatchSize: 94.46 MB (99043950) HDFS_SCAN_NODE (id=2):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.47 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s332ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 28.000ms (4.000ms) - Last Batch Returned: 1s328ms (1s300ms) - Closed: 1s332ms (4.000ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.17 KB (208041) ; Min: 6.09 KB (6237) ; Max: 596.25 KB (610559) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.70 KB (28369) ; Min: 3.04 KB (3118) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.22 KB (390370) ; Min: 40.76 KB (41742) ; Max: 1.01 MB (1056938) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.98 KB (53232) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.33 - BytesRead: 1.10 MB (1150959) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1150959) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484332) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475260) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.36 MB (3527164) - RowBatchQueuePutWaitTime: 2s312ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.08K (192079) - RowsReturned: 192.08K (192079) - RowsReturnedRate: 48.02 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s328ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 11.336ms - ScannerThreadsVoluntaryContextSwitches: 124 (124) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 749.32 KB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 20.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 20.000ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 12.000ms Instance 554562a26c33f0c6:2ec25d2f00000011 (host=impala-executor-000-0:22000):(Total: 1s319ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:56:02.477 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.76 KB Fragment Instance Lifecycle Event Timeline: 1s319ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 23.999ms (23.999ms) - First Batch Produced: 27.999ms (3.999ms) - First Batch Sent: 27.999ms (0.000ns) - ExecInternal Finished: 1s319ms (1s291ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.38 - PeakMemoryUsage: 5.28 MB (5532479) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1787538877) - RowsProduced: 192.08K (192079) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s251ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 3s627ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 87.909ms - TotalThreadsVoluntaryContextSwitches: 487 (487) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s295ms - ExecTreeExecTime: 7.999ms - OpenTime: 23.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s287ms, non-child: 35.999ms, % non-child: 2.80%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.29 MB, 5.17 MB - NetworkThroughput: (Avg: 85.79 MB/sec ; Min: 2.02 MB/sec ; Max: 318.83 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 425.585us ; Min: -28068135.000ns ; Max: 11.389ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 5.051ms ; Min: 13.878us ; Max: 944.692ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.08K (192079) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 27.999ms - TotalBytesSent: 43.23 MB (45327580) - UncompressedRowBatchSize: 94.47 MB (99063490) HDFS_SCAN_NODE (id=2):(Total: 7.999ms, non-child: 7.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.76 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s319ms - Open Started: 23.999ms (23.999ms) - Open Finished: 23.999ms (0.000ns) - First Batch Requested: 23.999ms (0.000ns) - First Batch Returned: 27.999ms (3.999ms) - Last Batch Returned: 1s287ms (1s259ms) - Closed: 1s319ms (31.999ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.19 KB (208070) ; Min: 6.25 KB (6396) ; Max: 596.21 KB (610514) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.71 KB (28373) ; Min: 3.11 KB (3180) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.22 KB (390371) ; Min: 40.77 KB (41745) ; Max: 1.01 MB (1056938) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.98 KB (53232) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1151072) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151072) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484335) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475263) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 3.36 MB (3527167) - RowBatchQueuePutWaitTime: 2s291ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.08K (192079) - RowsReturned: 192.08K (192079) - RowsReturnedRate: 24.01 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s307ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 12.549ms - ScannerThreadsVoluntaryContextSwitches: 123 (123) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 23.999ms, non-child: 23.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 23.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 21.421ms - CodegenVoluntaryContextSwitches: 3 (3) - CompileTime: 3.999ms - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 3.999ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f00000012 (host=impala-executor-000-2:22000):(Total: 1s284ms, non-child: 8.000ms, % non-child: 0.62%) Last report received time: 2019-11-21 22:56:02.476 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.50 KB Fragment Instance Lifecycle Event Timeline: 1s288ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 24.000ms (0.000ns) - First Batch Sent: 24.000ms (0.000ns) - ExecInternal Finished: 1s288ms (1s264ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.38 - PeakMemoryUsage: 5.28 MB (5532420) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785995032) - RowsProduced: 192.08K (192078) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s196ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 3s536ms - TotalThreadsSysTime: 7.394ms - TotalThreadsUserTime: 83.020ms - TotalThreadsVoluntaryContextSwitches: 491 (491) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s260ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s248ms, non-child: 52.000ms, % non-child: 4.17%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.40 MB, 4.40 MB - NetworkThroughput: (Avg: 87.92 MB/sec ; Min: 878.37 KB/sec ; Max: 324.85 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 439.487us ; Min: -12887073.000ns ; Max: 26.874ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 4.562ms ; Min: 11.261us ; Max: 944.517ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.08K (192078) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 48.000ms - TotalBytesSent: 43.23 MB (45326060) - UncompressedRowBatchSize: 94.46 MB (99050700) HDFS_SCAN_NODE (id=2):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.50 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s284ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 1s272ms (1s248ms) - Closed: 1s284ms (12.000ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.18 KB (208061) ; Min: 6.08 KB (6231) ; Max: 596.25 KB (610555) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.71 KB (28372) ; Min: 3.03 KB (3098) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.20 KB (390348) ; Min: 40.71 KB (41686) ; Max: 1.01 MB (1056930) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.98 KB (53229) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1151067) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151067) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 12.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484276) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475204) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePeakMemoryUsage: 3.38 MB (3541788) - RowBatchQueuePutWaitTime: 2s232ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.08K (192078) - RowsReturned: 192.08K (192078) - RowsReturnedRate: 48.02 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s252ms - ScannerThreadsSysTime: 3.775ms - ScannerThreadsUserTime: 10.626ms - ScannerThreadsVoluntaryContextSwitches: 144 (144) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 24.317ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 8.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 12.000ms Instance 554562a26c33f0c6:2ec25d2f00000013 (host=impala-executor-000-8:22000):(Total: 1s280ms, non-child: 20.000ms, % non-child: 1.56%) Last report received time: 2019-11-21 22:56:02.473 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/940.83 KB Fragment Instance Lifecycle Event Timeline: 1s280ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 23.999ms (19.999ms) - First Batch Produced: 27.999ms (3.999ms) - First Batch Sent: 27.999ms (0.000ns) - ExecInternal Finished: 1s280ms (1s252ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.35 - PeakMemoryUsage: 5.28 MB (5532241) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785237502) - RowsProduced: 191.69K (191694) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s184ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 3s584ms - TotalThreadsSysTime: 23.510ms - TotalThreadsUserTime: 63.754ms - TotalThreadsVoluntaryContextSwitches: 445 (445) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s256ms - ExecTreeExecTime: 8.000ms - OpenTime: 19.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 3.999ms - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s232ms, non-child: 48.000ms, % non-child: 3.90%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 5.35 MB, 5.35 MB - NetworkThroughput: (Avg: 84.39 MB/sec ; Min: 3.07 MB/sec ; Max: 331.60 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 407.306us ; Min: -3880263.000ns ; Max: 7.505ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 5.039ms ; Min: 12.784us ; Max: 944.443ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 191.69K (191694) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 28.000ms - TotalBytesSent: 43.13 MB (45228300) - UncompressedRowBatchSize: 94.27 MB (98844440) HDFS_SCAN_NODE (id=2):(Total: 8.000ms, non-child: 8.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/940.83 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s280ms - Open Started: 23.999ms (23.999ms) - Open Finished: 23.999ms (0.000ns) - First Batch Requested: 23.999ms (0.000ns) - First Batch Returned: 27.999ms (3.999ms) - Last Batch Returned: 1s272ms (1s244ms) - Closed: 1s280ms (8.000ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 202.60 KB (207465) ; Min: 5.95 KB (6092) ; Max: 594.72 KB (608992) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.63 KB (28290) ; Min: 2.91 KB (2976) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 380.14 KB (389265) ; Min: 40.68 KB (41652) ; Max: 1.01 MB (1053858) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.84 KB (53081) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1149267) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1149267) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 3.999ms - MaterializeTupleTime(*): 4.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484097) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475025) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 3.38 MB (3541747) - RowBatchQueuePutWaitTime: 2s272ms - RowBatchesEnqueued: 192 (192) - RowsRead: 191.69K (191694) - RowsReturned: 191.69K (191694) - RowsReturnedRate: 23.96 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 2s308ms - ScannerThreadsSysTime: 2.954ms - ScannerThreadsUserTime: 9.076ms - ScannerThreadsVoluntaryContextSwitches: 129 (129) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 19.999ms, non-child: 19.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 19.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 20.004ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 3.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 3.999ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 11.999ms Instance 554562a26c33f0c6:2ec25d2f0000000e (host=impala-executor-000-9:22000):(Total: 1s272ms, non-child: 4.000ms, % non-child: 0.31%) Last report received time: 2019-11-21 22:56:02.472 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/944.14 KB Fragment Instance Lifecycle Event Timeline: 1s272ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 28.000ms (4.000ms) - First Batch Sent: 28.000ms (0.000ns) - ExecInternal Finished: 1s272ms (1s244ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.38 - PeakMemoryUsage: 5.28 MB (5532710) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785885642) - RowsProduced: 192.47K (192466) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s216ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 3s528ms - TotalThreadsSysTime: 10.805ms - TotalThreadsUserTime: 77.706ms - TotalThreadsVoluntaryContextSwitches: 503 (503) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s248ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s240ms, non-child: 24.000ms, % non-child: 1.94%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 5.82 MB, 5.82 MB - NetworkThroughput: (Avg: 84.38 MB/sec ; Min: 1.38 MB/sec ; Max: 314.52 MB/sec ; Number of samples: 1890) - RpcNetworkTime: (Avg: 433.890us ; Min: -299833.000ns ; Max: 16.605ms ; Number of samples: 1900) - RpcRecvrTime: (Avg: 4.523ms ; Min: 12.407us ; Max: 909.516ms ; Number of samples: 1900) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.47K (192466) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 16.000ms - TotalBytesSent: 43.29 MB (45390100) - UncompressedRowBatchSize: 94.67 MB (99267320) HDFS_SCAN_NODE (id=2):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/944.14 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s272ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 28.000ms (4.000ms) - Last Batch Returned: 1s268ms (1s240ms) - Closed: 1s272ms (4.000ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.69 KB (208575) ; Min: 6.19 KB (6339) ; Max: 597.73 KB (612080) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.78 KB (28442) ; Min: 3.07 KB (3148) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 382.30 KB (391480) ; Min: 40.84 KB (41825) ; Max: 1.01 MB (1060034) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 52.13 KB (53383) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1152597) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1152597) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - MaterializeTupleTime(*): 4.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484566) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.21 MB (6509286) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3500143) - RowBatchQueuePutWaitTime: 2s208ms - RowBatchesEnqueued: 193 (193) - RowsRead: 192.47K (192466) - RowsReturned: 192.47K (192466) - RowsReturnedRate: 48.12 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 2s256ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 12.873ms - ScannerThreadsVoluntaryContextSwitches: 137 (137) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 3.597ms - CodegenUserTime: 17.985ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.000ms - IrGenerationTime: 4.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 12.000ms Instance 554562a26c33f0c6:2ec25d2f00000010 (host=impala-executor-000-3:22000):(Total: 1s175ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:56:02.475 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/470.66 KB Fragment Instance Lifecycle Event Timeline: 1s179ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 23.999ms (19.999ms) - First Batch Produced: 27.999ms (3.999ms) - First Batch Sent: 27.999ms (0.000ns) - ExecInternal Finished: 1s179ms (1s151ms) - MemoryUsage (500.000ms): 3.57 MB, 3.57 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.34 - PeakMemoryUsage: 4.27 MB (4482341) - PeakReservation: 528.00 KB (540672) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1781773442) - RowsProduced: 95.85K (95848) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s135ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 1s191ms - TotalThreadsSysTime: 11.263ms - TotalThreadsUserTime: 44.443ms - TotalThreadsVoluntaryContextSwitches: 224 (224) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s155ms - ExecTreeExecTime: 3.999ms - OpenTime: 19.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s151ms, non-child: 15.999ms, % non-child: 1.39%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.40 MB, 4.40 MB - NetworkThroughput: (Avg: 75.40 MB/sec ; Min: 1.51 MB/sec ; Max: 280.13 MB/sec ; Number of samples: 940) - RpcNetworkTime: (Avg: 598.044us ; Min: -881241.000ns ; Max: 15.205ms ; Number of samples: 950) - RpcRecvrTime: (Avg: 8.905ms ; Min: 16.315us ; Max: 942.290ms ; Number of samples: 950) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 95.85K (95848) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 7.999ms - TotalBytesSent: 21.57 MB (22613130) - UncompressedRowBatchSize: 47.14 MB (49427540) HDFS_SCAN_NODE (id=2):(Total: 3.999ms, non-child: 3.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/470.66 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 1s179ms - Open Started: 23.999ms (23.999ms) - Open Finished: 23.999ms (0.000ns) - First Batch Requested: 23.999ms (0.000ns) - First Batch Returned: 27.999ms (3.999ms) - Last Batch Returned: 1s175ms (1s147ms) - Closed: 1s179ms (3.999ms) - BytesRead (500.000ms): 561.39 KB, 561.39 KB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 101.39 KB (103820) ; Min: 3.11 KB (3189) ; Max: 297.35 KB (304482) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.65 KB (28314) ; Min: 3.11 KB (3189) ; Max: 64.14 KB (65683) ; Number of samples: 11) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 190.07 KB (194631) ; Min: 20.33 KB (20814) ; Max: 514.59 KB (526937) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.84 KB (53081) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 561.39 KB (574867) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 561.39 KB (574867) - DataCacheHitCount: 4 (4) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 3.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 11 (11) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 4.20 MB (4400405) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 3.09 MB (3237501) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 3.30 MB (3457661) - RowBatchQueuePutWaitTime: 7.999ms - RowBatchesEnqueued: 96 (96) - RowsRead: 95.85K (95848) - RowsReturned: 95.85K (95848) - RowsReturnedRate: 23.96 M/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 15.999ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.022ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 561.39 KB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 656.00 KB (671744) - CumulativeAllocations: 4 (4) - PeakReservation: 528.00 KB (540672) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 528.00 KB (540672) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 19.999ms, non-child: 19.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 19.999ms - CodegenSysTime: 3.979ms - CodegenUserTime: 15.918ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 3.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 3.999ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 11.999ms Averaged Fragment F04:(Total: 32.000ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 134.40 KB, max: 134.40 KB, avg: 134.40 KB, stddev: 0 completion times: min:5s012ms max:5s012ms mean: 5s012ms stddev:0.000ns execution rates: min:26.81 KB/sec max:26.81 KB/sec mean:26.81 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 1.09 - PeakMemoryUsage: 336.17 KB (344240) - PeakReservation: 128.00 KB (131072) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785404996) - RowsProduced: 1.50K (1500) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 4.000ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 36.000ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 25.152ms - TotalThreadsVoluntaryContextSwitches: 25 (25) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8.000ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=15):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) - EosSent: 10 (10) - PeakMemoryUsage: 142.19 KB (145600) - RowsSent: 1.50K (1500) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 117.34 KB (120160) - UncompressedRowBatchSize: 249.02 KB (255000) HDFS_SCAN_NODE (id=1):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 107.94 KB (110534) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 2 (2) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 107.94 KB (110534) - DataCacheHitCount: 2 (2) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 1 (1) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 185.72 KB (190176) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 26.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 18.00 KB (18432) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 34.00 KB (34816) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 4 (4) - RowsRead: 1.50K (1500) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 375.00 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 4.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.000ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 262.000us - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 4.000ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 136.00 KB (139264) - CumulativeAllocations: 2 (2) - PeakReservation: 128.00 KB (131072) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 23.971ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms Fragment F04: Instance 554562a26c33f0c6:2ec25d2f00000015 (host=impala-executor-000-1:22000):(Total: 32.000ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:56:02.471 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/134.40 KB Fragment Instance Lifecycle Event Timeline: 32.000ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 28.000ms (4.000ms) - First Batch Sent: 28.000ms (0.000ns) - ExecInternal Finished: 32.000ms (4.000ms) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 1.09 - PeakMemoryUsage: 336.17 KB (344240) - PeakReservation: 128.00 KB (131072) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785404996) - RowsProduced: 1.50K (1500) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 4.000ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 36.000ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 25.152ms - TotalThreadsVoluntaryContextSwitches: 25 (25) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8.000ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=15):(Total: 4.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - NetworkThroughput: (Avg: 18.42 MB/sec ; Min: 13.02 MB/sec ; Max: 31.89 MB/sec ; Number of samples: 20) - RpcNetworkTime: (Avg: 291.252us ; Min: 85.223us ; Max: 465.346us ; Number of samples: 30) - RpcRecvrTime: (Avg: 45.292us ; Min: 21.675us ; Max: 101.442us ; Number of samples: 30) - EosSent: 10 (10) - PeakMemoryUsage: 142.19 KB (145600) - RowsSent: 1.50K (1500) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 117.34 KB (120160) - UncompressedRowBatchSize: 249.02 KB (255000) HDFS_SCAN_NODE (id=1):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/134.40 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 32.000ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 28.000ms (4.000ms) - Last Batch Returned: 28.000ms (0.000ns) - Closed: 32.000ms (4.000ms) - FooterProcessingTime: (Avg: 4.000ms ; Min: 4.000ms ; Max: 4.000ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 2.04 KB (2084) ; Min: 2.04 KB (2084) ; Max: 2.04 KB (2084) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 2.04 KB (2084) ; Min: 2.04 KB (2084) ; Max: 2.04 KB (2084) ; Number of samples: 1) - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 2.03 KB (2079) ; Min: 2.03 KB (2079) ; Max: 2.03 KB (2079) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 2.03 KB (2079) ; Min: 2.03 KB (2079) ; Max: 2.03 KB (2079) ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 107.94 KB (110534) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 2 (2) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 107.94 KB (110534) - DataCacheHitCount: 2 (2) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 1 (1) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 185.72 KB (190176) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 26.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 18.00 KB (18432) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 34.00 KB (34816) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 4 (4) - RowsRead: 1.50K (1500) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 375.00 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 4.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.000ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 262.000us - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 4.000ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 136.00 KB (139264) - CumulativeAllocations: 2 (2) - PeakReservation: 128.00 KB (131072) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 23.971ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms Averaged Fragment F05:(Total: 32.000ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 41.76 KB, max: 41.76 KB, avg: 41.76 KB, stddev: 0 completion times: min:5s016ms max:5s016ms mean: 5s016ms stddev:0.000ns execution rates: min:8.33 KB/sec max:8.33 KB/sec mean:8.33 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 6.95 - PeakMemoryUsage: 414.44 KB (424387) - PeakReservation: 72.00 KB (73728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1787087088) - RowsProduced: 7.20K (7200) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 36.000ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 27.478ms - TotalThreadsVoluntaryContextSwitches: 46 (46) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8.000ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=16):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) - EosSent: 10 (10) - PeakMemoryUsage: 98.44 KB (100800) - RowsSent: 7.20K (7200) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 566.81 KB (580410) - UncompressedRowBatchSize: 1.44 MB (1512000) HDFS_SCAN_NODE (id=3):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 81.54 KB (83492) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 81.54 KB (83492) - DataCacheHitCount: 3 (3) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 294.74 KB (301811) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.00 KB (106496) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 163.00 KB (166912) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 10 (10) - RowsRead: 7.20K (7200) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 1.80 M/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.000ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 264.000us - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 136.00 KB (139264) - CumulativeAllocations: 3 (3) - PeakReservation: 72.00 KB (73728) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 72.00 KB (73728) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 25.345ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms Fragment F05: Instance 554562a26c33f0c6:2ec25d2f00000016 (host=impala-executor-000-5:22000):(Total: 32.000ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 22:56:02.476 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/41.76 KB Fragment Instance Lifecycle Event Timeline: 32.000ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 28.000ms (4.000ms) - First Batch Sent: 28.000ms (0.000ns) - ExecInternal Finished: 32.000ms (4.000ms) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 6.95 - PeakMemoryUsage: 414.44 KB (424387) - PeakReservation: 72.00 KB (73728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1787087088) - RowsProduced: 7.20K (7200) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 36.000ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 27.478ms - TotalThreadsVoluntaryContextSwitches: 46 (46) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8.000ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=16):(Total: 4.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - NetworkThroughput: (Avg: 28.55 MB/sec ; Min: 563.34 KB/sec ; Max: 105.21 MB/sec ; Number of samples: 80) - RpcNetworkTime: (Avg: 294.842us ; Min: 46.891us ; Max: 576.791us ; Number of samples: 90) - RpcRecvrTime: (Avg: 46.152us ; Min: 18.851us ; Max: 336.910us ; Number of samples: 90) - EosSent: 10 (10) - PeakMemoryUsage: 98.44 KB (100800) - RowsSent: 7.20K (7200) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 566.81 KB (580410) - UncompressedRowBatchSize: 1.44 MB (1512000) HDFS_SCAN_NODE (id=3):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/41.76 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 32.000ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 28.000ms (4.000ms) - Last Batch Returned: 28.000ms (0.000ns) - Closed: 32.000ms (4.000ms) - FooterProcessingTime: (Avg: 4.000ms ; Min: 4.000ms ; Max: 4.000ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 5.75 KB (5891) ; Min: 54.00 B (54) ; Max: 11.45 KB (11728) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 5.75 KB (5891) ; Min: 54.00 B (54) ; Max: 11.45 KB (11728) ; Number of samples: 2) - ParquetRowGroupActualReservation: (Avg: 72.00 KB (73728) ; Min: 72.00 KB (73728) ; Max: 72.00 KB (73728) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 72.00 KB (73728) ; Min: 72.00 KB (73728) ; Max: 72.00 KB (73728) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 5.82 KB (5956) ; Min: 190.00 B (190) ; Max: 11.45 KB (11723) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 5.82 KB (5956) ; Min: 190.00 B (190) ; Max: 11.45 KB (11723) ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 81.54 KB (83492) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 81.54 KB (83492) - DataCacheHitCount: 3 (3) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 294.74 KB (301811) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.00 KB (106496) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 163.00 KB (166912) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 10 (10) - RowsRead: 7.20K (7200) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 1.80 M/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.000ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 264.000us - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 136.00 KB (139264) - CumulativeAllocations: 3 (3) - PeakReservation: 72.00 KB (73728) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 72.00 KB (73728) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 25.345ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms