Query (id=2a45c19935b2f933:e73e987000000000): Summary: Session ID: c14c74c52854535b:c65a80d19c921797 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2019-11-21 23:02:30.727333000 End Time: 2019-11-21 23:03:14.696454000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 3.4.0-SNAPSHOT RELEASE (build 8b8951378e200329841bd38b1ef7abbe4ed9be61) User: csso_drorke Connected User: csso_drorke Delegated User: Network Address: 127.0.0.1:44432 Default Db: tpcds_10000_decimal_parquet Sql Statement: -- start query 1 in stream 0 using template query13.tpl and seed 622697896 select avg(ss_quantity) ,avg(ss_ext_sales_price) ,avg(ss_ext_wholesale_cost) ,sum(ss_ext_wholesale_cost) from store_sales ,store ,customer_demographics ,household_demographics ,customer_address ,date_dim where s_store_sk = ss_store_sk and ss_sold_date_sk = d_date_sk and d_year = 2001 and((ss_hdemo_sk=hd_demo_sk and cd_demo_sk = ss_cdemo_sk and cd_marital_status = 'U' and cd_education_status = 'Secondary' and ss_sales_price between 100.00 and 150.00 and hd_dep_count = 3 )or (ss_hdemo_sk=hd_demo_sk and cd_demo_sk = ss_cdemo_sk and cd_marital_status = 'W' and cd_education_status = 'College' and ss_sales_price between 50.00 and 100.00 and hd_dep_count = 1 ) or (ss_hdemo_sk=hd_demo_sk and cd_demo_sk = ss_cdemo_sk and cd_marital_status = 'D' and cd_education_status = 'Primary' and ss_sales_price between 150.00 and 200.00 and hd_dep_count = 1 )) and ca_state in ('TX', 'OK', 'MI', 'WA', 'NC', 'OH', 'MT', 'FL', 'GA') and((ss_addr_sk = ca_address_sk and ca_country = 'United States' and ca_state in ('TX', 'OK', 'MI') and ss_net_profit between 100 and 200 ) or (ss_addr_sk = ca_address_sk and ca_country = 'United States' and ca_state in ('WA', 'NC', 'OH') and ss_net_profit between 150 and 300 ) or (ss_addr_sk = ca_address_sk and ca_country = 'United States' and ca_state in ('MT', 'FL', 'GA') and ss_net_profit between 50 and 250 )) Coordinator: coordinator-0:22050 Query Options (set by configuration): TIMEZONE=UTC,CLIENT_IDENTIFIER=Impala Shell v3.3.0-SNAPSHOT (a509cff) built on Mon Jul 29 18:37:09 PDT 2019,NUM_REMOTE_EXECUTOR_CANDIDATES=2,DEFAULT_FILE_FORMAT=4,SPOOL_QUERY_RESULTS=1,DEFAULT_TRANSACTIONAL_TYPE=1 Query Options (set by configuration and planner): MT_DOP=0,TIMEZONE=UTC,CLIENT_IDENTIFIER=Impala Shell v3.3.0-SNAPSHOT (a509cff) built on Mon Jul 29 18:37:09 PDT 2019,NUM_REMOTE_EXECUTOR_CANDIDATES=2,DEFAULT_FILE_FORMAT=4,SPOOL_QUERY_RESULTS=1,DEFAULT_TRANSACTIONAL_TYPE=1 Plan: ---------------- Max Per-Host Resource Reservation: Memory=133.50MB Threads=13 Per-Host Resource Estimates: Memory=1.25GB Dedicated Coordinator Resource Estimate: Memory=120MB Analyzed query: SELECT avg(CAST(ss_quantity AS BIGINT)), avg(ss_ext_sales_price), avg(ss_ext_wholesale_cost), sum(ss_ext_wholesale_cost) FROM tpcds_10000_decimal_parquet.store_sales, tpcds_10000_decimal_parquet.store, tpcds_10000_decimal_parquet.customer_demographics, tpcds_10000_decimal_parquet.household_demographics, tpcds_10000_decimal_parquet.customer_address, tpcds_10000_decimal_parquet.date_dim WHERE s_store_sk = ss_store_sk AND ss_sold_date_sk = d_date_sk AND d_year = CAST(2001 AS INT) AND ss_hdemo_sk = hd_demo_sk AND cd_demo_sk = ss_cdemo_sk AND ((cd_marital_status = 'U' AND cd_education_status = 'Secondary' AND ss_sales_price >= CAST(100.00 AS DECIMAL(5,2)) AND ss_sales_price <= CAST(150.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(3 AS INT)) OR (cd_marital_status = 'W' AND cd_education_status = 'College' AND ss_sales_price >= CAST(50.00 AS DECIMAL(4,2)) AND ss_sales_price <= CAST(100.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(1 AS INT)) OR (cd_marital_status = 'D' AND cd_education_status = 'Primary' AND ss_sales_price >= CAST(150.00 AS DECIMAL(5,2)) AND ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(1 AS INT))) AND ca_state IN ('TX', 'OK', 'MI', 'WA', 'NC', 'OH', 'MT', 'FL', 'GA') AND ss_addr_sk = ca_address_sk AND ca_country = 'United States' AND ((ca_state IN ('TX', 'OK', 'MI') AND ss_net_profit >= CAST(100 AS DECIMAL(3,0)) AND ss_net_profit <= CAST(200 AS DECIMAL(5,0))) OR (ca_state IN ('WA', 'NC', 'OH') AND ss_net_profit >= CAST(150 AS DECIMAL(5,0)) AND ss_net_profit <= CAST(300 AS DECIMAL(5,0))) OR (ca_state IN ('MT', 'FL', 'GA') AND ss_net_profit >= CAST(50 AS DECIMAL(3,0)) AND ss_net_profit <= CAST(250 AS DECIMAL(5,0)))) F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=14.00MB mem-reservation=4.00MB thread-reservation=1 PLAN-ROOT SINK | output exprs: avg(ss_quantity), avg(ss_ext_sales_price), avg(ss_ext_wholesale_cost), sum(ss_ext_wholesale_cost) | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 | 18:AGGREGATE [FINALIZE] | output: avg:merge(ss_quantity), avg:merge(ss_ext_sales_price), avg:merge(ss_ext_wholesale_cost), sum:merge(ss_ext_wholesale_cost) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=7 row-size=40B cardinality=1 | in pipelines: 18(GETNEXT), 11(OPEN) | 17:EXCHANGE [UNPARTITIONED] | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | tuple-ids=6 row-size=40B cardinality=1 | in pipelines: 11(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 Per-Host Resources: mem-estimate=1020.72MB mem-reservation=119.81MB thread-reservation=2 runtime-filters-memory=6.00MB 11:AGGREGATE | output: avg(CAST(ss_quantity AS BIGINT)), avg(ss_ext_sales_price), avg(ss_ext_wholesale_cost), sum(ss_ext_wholesale_cost) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=6 row-size=40B cardinality=1 | in pipelines: 11(GETNEXT), 00(OPEN) | 10:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_hdemo_sk = hd_demo_sk | fk/pk conjuncts: ss_hdemo_sk = hd_demo_sk | other predicates: ((cd_marital_status = 'U' AND cd_education_status = 'Secondary' AND ss_sales_price >= CAST(100.00 AS DECIMAL(5,2)) AND ss_sales_price <= CAST(150.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(3 AS INT)) OR (cd_marital_status = 'W' AND cd_education_status = 'College' AND ss_sales_price >= CAST(50.00 AS DECIMAL(4,2)) AND ss_sales_price <= CAST(100.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(1 AS INT)) OR (cd_marital_status = 'D' AND cd_education_status = 'Primary' AND ss_sales_price >= CAST(150.00 AS DECIMAL(5,2)) AND ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)) AND hd_dep_count = CAST(1 AS INT))) | runtime filters: RF000[bloom] <- hd_demo_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=0,4,5,2,1,3 row-size=181B cardinality=708.89M | in pipelines: 00(GETNEXT), 03(OPEN) | |--16:EXCHANGE [BROADCAST] | | mem-estimate=100.38KB mem-reservation=0B thread-reservation=0 | | tuple-ids=3 row-size=12B cardinality=7.20K | | in pipelines: 03(GETNEXT) | | | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=32.00MB mem-reservation=64.00KB thread-reservation=2 | 03:SCAN S3 [tpcds_10000_decimal_parquet.household_demographics, RANDOM] | S3 partitions=1/1 files=1 size=41.76KB | stored statistics: | table: rows=7.20K size=41.76KB | columns: all | extrapolated-rows=disabled max-scan-range-rows=7.20K | mem-estimate=32.00MB mem-reservation=64.00KB thread-reservation=1 | tuple-ids=3 row-size=12B cardinality=7.20K | in pipelines: 03(GETNEXT) | 09:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | fk/pk conjuncts: ss_store_sk = s_store_sk | runtime filters: RF002[bloom] <- s_store_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=0,4,5,2,1 row-size=169B cardinality=708.89M | in pipelines: 00(GETNEXT), 01(OPEN) | |--15:EXCHANGE [BROADCAST] | | mem-estimate=23.72KB mem-reservation=0B thread-reservation=0 | | tuple-ids=1 row-size=8B cardinality=1.50K | | in pipelines: 01(GETNEXT) | | | F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=2 | 01:SCAN S3 [tpcds_10000_decimal_parquet.store, RANDOM] | S3 partitions=1/1 files=1 size=134.40KB | stored statistics: | table: rows=1.50K size=134.40KB | columns: all | extrapolated-rows=disabled max-scan-range-rows=1.50K | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=1 | tuple-ids=1 row-size=8B cardinality=1.50K | in pipelines: 01(GETNEXT) | 08:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_cdemo_sk = cd_demo_sk | fk/pk conjuncts: ss_cdemo_sk = cd_demo_sk | runtime filters: RF004[bloom] <- cd_demo_sk | mem-estimate=85.78MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=0,4,5,2 row-size=161B cardinality=708.89M | in pipelines: 00(GETNEXT), 02(OPEN) | |--14:EXCHANGE [BROADCAST] | | mem-estimate=10.45MB mem-reservation=0B thread-reservation=0 | | tuple-ids=2 row-size=43B cardinality=1.92M | | in pipelines: 02(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | Per-Host Resources: mem-estimate=48.00MB mem-reservation=512.00KB thread-reservation=2 | 02:SCAN S3 [tpcds_10000_decimal_parquet.customer_demographics, RANDOM] | S3 partitions=1/1 files=20 size=9.21MB | stored statistics: | table: rows=1.92M size=9.21MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=96.51K | mem-estimate=48.00MB mem-reservation=512.00KB thread-reservation=1 | tuple-ids=2 row-size=43B cardinality=1.92M | in pipelines: 02(GETNEXT) | 07:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | fk/pk conjuncts: ss_sold_date_sk = d_date_sk | runtime filters: RF006[bloom] <- d_date_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=0,4,5 row-size=119B cardinality=717.09M | in pipelines: 00(GETNEXT), 05(OPEN) | |--13:EXCHANGE [BROADCAST] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | | tuple-ids=5 row-size=12B cardinality=373 | | in pipelines: 05(GETNEXT) | | | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=32.00MB mem-reservation=1.00MB thread-reservation=2 | 05:SCAN S3 [tpcds_10000_decimal_parquet.date_dim, RANDOM] | S3 partitions=1/1 files=1 size=2.15MB | predicates: d_year = CAST(2001 AS INT) | stored statistics: | table: rows=73.05K size=2.15MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=73.05K | parquet statistics predicates: d_year = CAST(2001 AS INT) | parquet dictionary predicates: d_year = CAST(2001 AS INT) | mem-estimate=32.00MB mem-reservation=1.00MB thread-reservation=1 | tuple-ids=5 row-size=12B cardinality=373 | in pipelines: 05(GETNEXT) | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_addr_sk = ca_address_sk | fk/pk conjuncts: ss_addr_sk = ca_address_sk | other predicates: ((ca_state IN ('TX', 'OK', 'MI') AND ss_net_profit >= CAST(100 AS DECIMAL(3,0)) AND ss_net_profit <= CAST(200 AS DECIMAL(5,0))) OR (ca_state IN ('WA', 'NC', 'OH') AND ss_net_profit >= CAST(150 AS DECIMAL(5,0)) AND ss_net_profit <= CAST(300 AS DECIMAL(5,0))) OR (ca_state IN ('MT', 'FL', 'GA') AND ss_net_profit >= CAST(50 AS DECIMAL(3,0)) AND ss_net_profit <= CAST(250 AS DECIMAL(5,0)))) | runtime filters: RF008[bloom] <- ca_address_sk | mem-estimate=198.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | tuple-ids=0,4 row-size=107B cardinality=3.59G | in pipelines: 00(GETNEXT), 04(OPEN) | |--12:EXCHANGE [BROADCAST] | | mem-estimate=10.49MB mem-reservation=0B thread-reservation=0 | | tuple-ids=4 row-size=47B cardinality=4.06M | | in pipelines: 04(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10 | Per-Host Resources: mem-estimate=120.00MB mem-reservation=8.00MB thread-reservation=2 | 04:SCAN S3 [tpcds_10000_decimal_parquet.customer_address, RANDOM] | S3 partitions=1/1 files=20 size=599.67MB | predicates: ca_state IN ('TX', 'OK', 'MI', 'WA', 'NC', 'OH', 'MT', 'FL', 'GA'), ca_country = 'United States' | stored statistics: | table: rows=32.50M size=599.67MB | columns: all | extrapolated-rows=disabled max-scan-range-rows=1.63M | parquet statistics predicates: ca_state IN ('TX', 'OK', 'MI', 'WA', 'NC', 'OH', 'MT', 'FL', 'GA'), ca_country = 'United States' | parquet dictionary predicates: ca_state IN ('TX', 'OK', 'MI', 'WA', 'NC', 'OH', 'MT', 'FL', 'GA'), ca_country = 'United States' | mem-estimate=120.00MB mem-reservation=8.00MB thread-reservation=1 | tuple-ids=4 row-size=47B cardinality=4.06M | in pipelines: 04(GETNEXT) | 00:SCAN S3 [tpcds_10000_decimal_parquet.store_sales, RANDOM] S3 partitions=1824/1824 files=5998 size=1.36TB runtime filters: RF000[bloom] -> ss_hdemo_sk, RF002[bloom] -> ss_store_sk, RF004[bloom] -> ss_cdemo_sk, RF006[bloom] -> ss_sold_date_sk, RF008[bloom] -> ss_addr_sk stored statistics: table: rows=28.80G size=1.36TB partitions: 1824/1824 rows=28.80G columns: all extrapolated-rows=disabled max-scan-range-rows=5.13M mem-estimate=704.00MB mem-reservation=40.00MB thread-reservation=1 tuple-ids=0 row-size=60B cardinality=28.80G in pipelines: 00(GETNEXT) ---------------- Estimated Per-Host Mem: 1345030227 Request Pool: root.default Per Host Min Memory Reservation: impala-executor-000-3:22000(128.31 MB) coordinator-0:22050(4.00 MB) impala-executor-000-6:22000(128.31 MB) impala-executor-000-7:22000(128.31 MB) impala-executor-000-1:22000(128.44 MB) impala-executor-000-2:22000(129.31 MB) impala-executor-000-5:22000(128.38 MB) impala-executor-000-8:22000(120.31 MB) impala-executor-000-0:22000(128.31 MB) impala-executor-000-9:22000(128.31 MB) impala-executor-000-4:22000(128.31 MB) Per Host Number of Fragment Instances: impala-executor-000-3:22000(3) coordinator-0:22050(1) impala-executor-000-6:22000(3) impala-executor-000-7:22000(3) impala-executor-000-1:22000(4) impala-executor-000-2:22000(4) impala-executor-000-5:22000(4) impala-executor-000-8:22000(2) impala-executor-000-0:22000(3) impala-executor-000-9:22000(3) impala-executor-000-4:22000(3) Admission result: Admitted immediately Cluster Memory Admitted: 20.12 GB Executor Group: root.default-group-000 ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail -------------------------------------------------------------------------------------------------------------------------------------------------------- F06:ROOT 1 0.000ns 0.000ns 4.01 MB 4.00 MB 18:AGGREGATE 1 0.000ns 0.000ns 1 1 16.00 KB 10.00 MB FINALIZE 17:EXCHANGE 1 0.000ns 0.000ns 10 1 88.00 KB 16.00 KB UNPARTITIONED F00:EXCHANGE SENDER 10 0.000ns 0.000ns 1.58 KB 0 11:AGGREGATE 10 6s355ms 6s595ms 10 1 18.59 MB 10.00 MB 10:HASH JOIN 10 1s295ms 1s468ms 86.54K 708.89M 19.93 MB 1.94 MB INNER JOIN, BROADCAST |--16:EXCHANGE 10 399.998us 3.999ms 7.20K 7.20K 184.00 KB 100.38 KB BROADCAST | F05:EXCHANGE SENDER 1 0.000ns 0.000ns 98.44 KB 0 | 03:SCAN S3 1 0.000ns 0.000ns 7.20K 7.20K 294.74 KB 32.00 MB tpcds_10000_decimal_parquet.household_demographics 09:HASH JOIN 10 308.800ms 492.001ms 63.03M 708.89M 17.32 MB 1.94 MB INNER JOIN, BROADCAST |--15:EXCHANGE 10 0.000ns 0.000ns 1.50K 1.50K 40.00 KB 23.72 KB BROADCAST | F04:EXCHANGE SENDER 1 4.000ms 4.000ms 142.19 KB 0 | 01:SCAN S3 1 0.000ns 0.000ns 1.50K 1.50K 181.72 KB 16.00 MB tpcds_10000_decimal_parquet.store 08:HASH JOIN 10 927.600ms 1s024ms 63.23M 708.89M 170.47 MB 85.78 MB INNER JOIN, BROADCAST |--14:EXCHANGE 10 26.400ms 48.000ms 1.92M 1.92M 14.33 MB 10.45 MB BROADCAST | F03:EXCHANGE SENDER 10 32.000ms 67.999ms 38.75 KB 0 | 02:SCAN S3 10 6.000ms 11.999ms 1.92M 1.92M 6.22 MB 48.00 MB tpcds_10000_decimal_parquet.customer_demographics 07:HASH JOIN 10 261.200ms 339.997ms 63.62M 717.09M 8.03 MB 1.94 MB INNER JOIN, BROADCAST |--13:EXCHANGE 10 0.000ns 0.000ns 365 373 16.00 KB 16.00 KB BROADCAST | F02:EXCHANGE SENDER 1 0.000ns 0.000ns 98.44 KB 0 | 05:SCAN S3 1 4.000ms 4.000ms 365 373 1.63 MB 32.00 MB tpcds_10000_decimal_parquet.date_dim 06:HASH JOIN 10 28s153ms 29s432ms 63.62M 3.59B 704.16 MB 198.04 MB INNER JOIN, BROADCAST |--12:EXCHANGE 10 114.800ms 148.000ms 9.17M 4.06M 13.16 MB 10.49 MB BROADCAST | F01:EXCHANGE SENDER 9 229.333ms 340.002ms 38.75 KB 0 | 04:SCAN S3 9 12.000ms 16.000ms 9.17M 4.06M 42.62 MB 120.00 MB tpcds_10000_decimal_parquet.customer_address 00:SCAN S3 10 2s931ms 3s143ms 5.47B 28.80B 800.72 MB 704.00 MB tpcds_10000_decimal_parquet.store_sales Errors: Query Compilation: 64.341ms - Metadata of all 6 tables cached: 6.435ms (6.435ms) - Analysis finished: 7.577ms (1.142ms) - Authorization finished (ranger): 8.053ms (475.720us) - Value transfer graph computed: 8.367ms (313.816us) - Single node plan created: 54.603ms (46.236ms) - Runtime filters computed: 54.851ms (247.739us) - Distributed plan created: 54.884ms (32.774us) - Lineage info computed: 55.016ms (131.927us) - Planning finished: 64.341ms (9.325ms) Query Timeline: 44s368ms - Query submitted: 0.000ns (0.000ns) - Planning finished: 72.000ms (72.000ms) - Submit for admission: 84.000ms (12.000ms) - Completed admission: 96.000ms (12.000ms) - Ready to start on 11 backends: 96.000ms (0.000ns) - All 11 execution backends (33 fragment instances) started: 104.000ms (8.000ms) - Rows available: 43s156ms (43s052ms) - First row fetched: 43s968ms (812.000ms) - Last row fetched: 43s968ms (0.000ns) - Released admission control resources: 43s972ms (4.000ms) - Unregister query: 44s344ms (372.000ms) - AdmissionControlTimeSinceLastUpdate: 46.000ms - ComputeScanRangeAssignmentTimer: 8.000ms Frontend: - CatalogFetch.ColumnStats.Hits: 107 - CatalogFetch.ColumnStats.Requests: 107 - CatalogFetch.ColumnStats.Time: 0 - CatalogFetch.Config.Hits: 1 - CatalogFetch.Config.Requests: 1 - CatalogFetch.Config.Time: 0 - CatalogFetch.DatabaseList.Hits: 1 - CatalogFetch.DatabaseList.Requests: 1 - CatalogFetch.DatabaseList.Time: 0 - CatalogFetch.PartitionLists.Hits: 6 - CatalogFetch.PartitionLists.Requests: 6 - CatalogFetch.PartitionLists.Time: 0 - CatalogFetch.Partitions.Hits: 3658 - CatalogFetch.Partitions.Requests: 3658 - CatalogFetch.Partitions.Time: 3ms - CatalogFetch.TableNames.Hits: 1 - CatalogFetch.TableNames.Requests: 1 - CatalogFetch.TableNames.Time: 0 - CatalogFetch.Tables.Hits: 6 - CatalogFetch.Tables.Requests: 6 - CatalogFetch.Tables.Time: 0 ImpalaServer: - ClientFetchWaitTimer: 1s180ms - NumRowsFetched: 1 (1) - NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 124.00 /sec - RowMaterializationTimer: 8.000ms Execution Profile 2a45c19935b2f933:e73e987000000000:(Total: 43s068ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 5 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 8 6 0 LOCAL false 0 (10) N/A N/A true 6 7 0 LOCAL true 0 (10) N/A N/A true 4 8 0 LOCAL false 0 (10) N/A N/A true 2 9 0 LOCAL false 0 (10) N/A N/A true 0 10 0 LOCAL false 0 (10) N/A N/A true Backend startup latencies: Count: 11, min / max: 2ms / 5ms, 25th %-ile: 3ms, 50th %-ile: 3ms, 75th %-ile: 4ms, 90th %-ile: 5ms, 95th %-ile: 5ms, 99.9th %-ile: 5ms Slowest backend to start up: impala-executor-000-2:22000 Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 8 6 0 LOCAL false 0 (10) N/A N/A true 6 7 0 LOCAL true 0 (10) N/A N/A true 4 8 0 LOCAL false 0 (10) N/A N/A true 2 9 0 LOCAL false 0 (10) N/A N/A true 0 10 0 LOCAL false 0 (10) N/A N/A true Per Node Peak Memory Usage: impala-executor-000-3:22000(1.66 GB) coordinator-0:22050(4.11 MB) impala-executor-000-6:22000(1.66 GB) impala-executor-000-7:22000(1.66 GB) impala-executor-000-1:22000(1.66 GB) impala-executor-000-2:22000(1.66 GB) impala-executor-000-5:22000(1.66 GB) impala-executor-000-8:22000(1.66 GB) impala-executor-000-0:22000(1.66 GB) impala-executor-000-9:22000(1.66 GB) impala-executor-000-4:22000(1.66 GB) Per Node Bytes Read: impala-executor-000-3:22000(10.44 GB) coordinator-0:22050(0) impala-executor-000-6:22000(10.31 GB) impala-executor-000-7:22000(10.34 GB) impala-executor-000-1:22000(10.32 GB) impala-executor-000-2:22000(10.33 GB) impala-executor-000-5:22000(10.42 GB) impala-executor-000-8:22000(10.37 GB) impala-executor-000-0:22000(10.37 GB) impala-executor-000-9:22000(10.34 GB) impala-executor-000-4:22000(10.32 GB) Per Node User Time: impala-executor-000-3:22000(1m34s) coordinator-0:22050(23.258ms) impala-executor-000-6:22000(1m37s) impala-executor-000-7:22000(1m35s) impala-executor-000-1:22000(1m38s) impala-executor-000-2:22000(1m35s) impala-executor-000-5:22000(1m35s) impala-executor-000-8:22000(1m34s) impala-executor-000-0:22000(1m36s) impala-executor-000-9:22000(1m36s) impala-executor-000-4:22000(1m37s) Per Node System Time: impala-executor-000-3:22000(24s726ms) coordinator-0:22050(0.000ns) impala-executor-000-6:22000(24s702ms) impala-executor-000-7:22000(24s079ms) impala-executor-000-1:22000(24s829ms) impala-executor-000-2:22000(24s539ms) impala-executor-000-5:22000(24s653ms) impala-executor-000-8:22000(23s960ms) impala-executor-000-0:22000(24s912ms) impala-executor-000-9:22000(24s769ms) impala-executor-000-4:22000(24s833ms) - ExchangeScanRatio: 0.02 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - InnerNodeSelectivityRatio: 0.00 - NumBackends: 11 (11) - NumCompletedBackends: 11 (11) - NumFragmentInstances: 33 (33) - NumFragments: 7 (7) - TotalBytesRead: 103.57 GB (111202586372) - TotalBytesSent: 2.51 GB (2691764680) - TotalCpuTime: 20m8s - TotalInnerBytesSent: 0 - TotalScanBytesSent: 2.51 GB (2691764680) Per Node Profiles: impala-executor-000-3:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns coordinator-0:22050: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns impala-executor-000-6:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns impala-executor-000-7:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns impala-executor-000-1:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns impala-executor-000-2:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns impala-executor-000-5:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns impala-executor-000-8:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns impala-executor-000-0:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns impala-executor-000-9:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns impala-executor-000-4:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Averaged Fragment F06:(Total: 43s860ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:43s872ms max:43s872ms mean: 43s872ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 4.03 MB (4223192) - PeakReservation: 4.00 MB (4194304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 4.11 MB (4309208) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 43s028ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 43s860ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 23.258ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 812.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 43s048ms - ExecTreeOpenTime: 43s028ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns PLAN_ROOT_SINK:(Total: 812.000ms, non-child: 812.000ms, % non-child: 100.00%) - PeakMemoryUsage: 4.01 MB (4202496) - RowBatchGetWaitTime: 0.000ns - RowBatchSendWaitTime: 0.000ns - RowsSent: 1 (1) - RowsSentRate: 1.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 100.00 MB (104857600) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns AGGREGATION_NODE (id=18):(Total: 43s028ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) EXCHANGE_NODE (id=17):(Total: 43s028ms, non-child: 43s028ms, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 88.00 KB (90112) - RowsReturned: 10 (10) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 160.00 KB (163840) - CumulativeAllocations: 20 (20) - PeakReservation: 88.00 KB (90112) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 88.00 KB (90112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 40s280ms - TotalBytesDequeued: 890.00 B (890) - TotalGetBatchTime: 43s028ms - DataWaitTime: 43s028ms Enqueue: - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 10 (10) - TotalBatchesReceived: 10 (10) - TotalBytesReceived: 500.00 B (500) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 20.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 19.061ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 7 (7) - NumInstructions: 83 (83) - OptimizationTime: 8.000ms - PeakMemoryUsage: 41.50 KB (42496) - PrepareTime: 12.000ms Coordinator Fragment F06: Instance 2a45c19935b2f933:e73e987000000000 (host=coordinator-0:22050):(Total: 43s860ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:14.696 Fragment Instance Lifecycle Event Timeline: 43s864ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 43s048ms (43s048ms) - First Batch Produced: 43s048ms (0.000ns) - First Batch Sent: 43s048ms (0.000ns) - ExecInternal Finished: 43s864ms (816.000ms) - MemoryUsage (1s000ms): 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 12.21 KB, 30.21 KB, 72.21 KB, 92.21 KB, 4.03 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 4.03 MB (4223192) - PeakReservation: 4.00 MB (4194304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 4.11 MB (4309208) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 43s028ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 43s860ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 23.258ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 812.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 43s048ms - ExecTreeOpenTime: 43s028ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns PLAN_ROOT_SINK:(Total: 812.000ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 4.01 MB (4202496) - RowBatchGetWaitTime: 0.000ns - RowBatchSendWaitTime: 0.000ns - RowsSent: 1 (1) - RowsSentRate: 1.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 100.00 MB (104857600) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns AGGREGATION_NODE (id=18):(Total: 43s028ms, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 43s860ms - Open Started: 20.000ms (20.000ms) - Open Finished: 43s048ms (43s028ms) - First Batch Requested: 43s048ms (0.000ns) - First Batch Returned: 43s048ms (0.000ns) - Last Batch Returned: 43s048ms (0.000ns) - Closed: 43s860ms (812.000ms) - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) EXCHANGE_NODE (id=17):(Total: 43s028ms, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 43s048ms - Open Started: 20.000ms (20.000ms) - Open Finished: 40s300ms (40s280ms) - First Batch Requested: 40s300ms (0.000ns) - First Batch Returned: 43s048ms (2s748ms) - Last Batch Returned: 43s048ms (0.000ns) - Closed: 43s048ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 88.00 KB (90112) - RowsReturned: 10 (10) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 160.00 KB (163840) - CumulativeAllocations: 20 (20) - PeakReservation: 88.00 KB (90112) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 88.00 KB (90112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 89.00 B, 445.00 B, 667.00 B - FirstBatchWaitTime: 40s280ms - TotalBytesDequeued: 890.00 B (890) - TotalGetBatchTime: 43s028ms - DataWaitTime: 43s028ms Enqueue: - BytesReceived (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 50.00 B, 252.00 B, 374.00 B - DeferredQueueSize (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 46.558us ; Min: 22.401us ; Max: 57.792us ; Number of samples: 10) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 10 (10) - TotalBatchesReceived: 10 (10) - TotalBytesReceived: 500.00 B (500) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 20.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 19.061ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0.000ns - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 7 (7) - NumInstructions: 83 (83) - OptimizationTime: 8.000ms - PeakMemoryUsage: 41.50 KB (42496) - PrepareTime: 12.000ms Averaged Fragment F00:(Total: 41s572ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 138.82 GB, max: 139.24 GB, avg: 139.03 GB, stddev: 120.59 MB completion times: min:40s308ms max:43s052ms mean: 41s580ms stddev:933.938ms execution rates: min:3.23 GB/sec max:3.45 GB/sec mean:3.35 GB/sec stddev:75.38 MB/sec num instances: 10 - AverageThreadTokens: 12.92 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1785400364) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785400364) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 359.200ms - TotalNetworkSendTime: 800.000us - TotalStorageWaitTime: 4s919ms - TotalThreadsInvoluntaryContextSwitches: 884 (884) - TotalThreadsTotalWallClockTime: 8m58s - TotalThreadsSysTime: 24s522ms - TotalThreadsUserTime: 1m35s - TotalThreadsVoluntaryContextSwitches: 541.34K (541341) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1.199ms - ExecTreeExecTime: 399.999us - OpenTime: 41s570ms - ExecTreeOpenTime: 40s635ms - PrepareTime: 1.600ms - ExecTreePrepareTime: 1.600ms KrpcDataStreamSender (dst_id=17):(Total: 800.000us, non-child: 800.000us, % non-child: 100.00%) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 50.00 B (50) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 40s637ms, non-child: 6s355ms, % non-child: 15.64%) - PeakMemoryUsage: 16.92 MB (17746739) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: - BuildTime: 1.999ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 34s282ms, non-child: 1s295ms, % non-child: 3.78%) - BuildRows: 7.20K (7200) - BuildTime: 3.200ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 15.38 MB (16131328) - ProbeRows: 6.30M (6303343) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s278ms - RowsReturned: 8.65K (8653) - RowsReturnedRate: 252.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): - BuildRowsPartitionTime: 800.002us - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.30M (6300820) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16):(Total: 399.998us, non-child: 399.998us, % non-child: 100.00%) - ConvertRowBatchTime: 399.998us - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 180.00 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 32s986ms, non-child: 308.800ms, % non-child: 0.94%) - BuildRows: 1.50K (1500) - BuildTime: 3.600ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 14.32 MB (15020288) - ProbeRows: 6.32M (6323006) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 296.000ms - RowsReturned: 6.30M (6303343) - RowsReturnedRate: 191.22 K/sec Buffer pool: - AllocTime: 400.001us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): - BuildRowsPartitionTime: 800.002us - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.30M (6304843) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 399.998us - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 399.998us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 399.998us - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 32s677ms, non-child: 927.600ms, % non-child: 2.84%) - BuildRows: 1.92M (1920800) - BuildTime: 287.600ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 168.28 MB (176455731) - ProbeRows: 6.36M (6361724) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 914.400ms - RowsReturned: 6.32M (6323006) - RowsReturnedRate: 193.61 K/sec Buffer pool: - AllocTime: 2.000ms - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 2.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): - BuildRowsPartitionTime: 193.600ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 90.800ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.24M (8243806) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 78.400ms, non-child: 78.400ms, % non-child: 100.00%) - ConvertRowBatchTime: 21.200ms - PeakMemoryUsage: 14.27 MB (14962277) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 28.11 M/sec Buffer pool: - AllocTime: 4.399ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.06 MB (14747238) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.06 MB (14747238) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 2.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 54.800ms - DataWaitTime: 52.000ms Enqueue: - DeserializeRowBatchTime: 108.400ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 922.585ms - TotalRPCsDeferred: 168 (168) HASH_JOIN_NODE (id=7):(Total: 31s750ms, non-child: 261.200ms, % non-child: 0.82%) - BuildRows: 365 (365) - BuildTime: 3.600ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 7.97 MB (8355481) - ProbeRows: 6.36M (6361724) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 251.600ms - RowsReturned: 6.36M (6361724) - RowsReturnedRate: 200.48 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.36M (6362089) - Resizes: 0 (0) - Travel: 2.13M (2134392) EXCHANGE_NODE (id=13): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 31s488ms, non-child: 28s153ms, % non-child: 89.41%) - BuildRows: 9.17M (9173330) - BuildTime: 1s361ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 546.92M (546919396) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26s630ms - RowsReturned: 6.36M (6361724) - RowsReturnedRate: 202.14 K/sec Buffer pool: - AllocTime: 5.200ms - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.800ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): - BuildRowsPartitionTime: 912.401ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 445.200ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 543.25M (543245189) - Resizes: 0 (0) - Travel: 357.75M (357745272) EXCHANGE_NODE (id=12):(Total: 403.600ms, non-child: 403.600ms, % non-child: 100.00%) - ConvertRowBatchTime: 97.200ms - PeakMemoryUsage: 13.11 MB (13742561) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 25.72 M/sec Buffer pool: - AllocTime: 5.200ms - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 12.94 MB (13573324) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.94 MB (13573324) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 800.004us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 301.600ms - DataWaitTime: 288.800ms Enqueue: - DeserializeRowBatchTime: 434.800ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 946.282ms - TotalRPCsDeferred: 846 (846) HDFS_SCAN_NODE (id=0):(Total: 2s931ms, non-child: 2s931ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 12.16 - BytesRead: 10.34 GB (11102938820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4.10K (4100) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.31 GB (11064928340) - DataCacheHitCount: 4.09K (4086) - DataCacheMissBytes: 36.25 MB (38010480) - DataCacheMissCount: 15 (15) - DataCachePartialHitCount: 6 (6) - DecompressionTime: 8s568ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 263.59K (263590) - NumRowGroups: 115 (115) - NumRowGroupsWithPageIndex: 115 (115) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 799.69 MB (838534571) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.59 GB (33918201036) - RowBatchQueueGetWaitTime: 119.999ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6736076) - RowBatchQueuePutWaitTime: 6m53s - RowBatchesEnqueued: 534.35K (534354) - RowsRead: 547.00M (547000765) - RowsReturned: 546.92M (546919396) - RowsReturnedRate: 186.87 M/sec - ScanRangesComplete: 599 (599) - ScannerIoWaitTime: 4s919ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 796 (796) - ScannerThreadsTotalWallClockTime: 8m14s - ScannerThreadsSysTime: 16s302ms - ScannerThreadsUserTime: 1m2s - ScannerThreadsVoluntaryContextSwitches: 537.62K (537615) - TotalRawHdfsOpenFileTime(*): 51.600ms - TotalRawHdfsReadTime(*): 9s760ms - TotalReadThroughput: 254.29 MB/sec Buffer pool: - AllocTime: 498.800ms - CumulativeAllocationBytes: 6.17 GB (6623891456) - CumulativeAllocations: 1.30K (1296) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 722.73 MB (757838643) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 498.400ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1973740) - Rows rejected: 46.40K (46397) - Rows total: 547.00M (547000765) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1927343) - Rows rejected: 23.32K (23325) - Rows total: 546.95M (546954367) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.90M (1904017) - Rows rejected: 11.64K (11645) - Rows total: 546.93M (546931042) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 599 (599) - Files rejected: 484 (484) - Files total: 599 (599) - RowGroups processed: 534.12K (534122) - RowGroups rejected: 0 (0) - RowGroups total: 534.12K (534122) - Rows processed: 1.89M (1892371) - Rows rejected: 0 (0) - Rows total: 546.92M (546919396) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.89M (1892371) - Rows rejected: 0 (0) - Rows total: 546.92M (546919396) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 934.401ms, non-child: 934.401ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 3 (3) - CodegenTotalWallClockTime: 934.401ms - CodegenSysTime: 6.790ms - CodegenUserTime: 926.630ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 285.600ms - IrGenerationTime: 30.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 604.400ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 13.200ms Fragment F00: Instance 2a45c19935b2f933:e73e98700000001f (host=impala-executor-000-4:22000):(Total: 43s044ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:13.880 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:597/139.06 GB Filter 0 arrival: 923ms Filter 2 arrival: 923ms Filter 6 arrival: 923ms Filter 4 arrival: 1s211ms Filter 8 arrival: 2s263ms Fragment Instance Lifecycle Event Timeline: 43s044ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 43s040ms (43s040ms) - First Batch Produced: 43s040ms (0.000ns) - First Batch Sent: 43s040ms (0.000ns) - ExecInternal Finished: 43s044ms (4.000ms) - MemoryUsage (1s000ms): 40.73 MB, 328.15 MB, 745.12 MB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.46 GB, 1.29 GB - ThreadUsage (1s000ms): 1, 2, 2, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 10, 7 - AverageThreadTokens: 12.92 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1785051113) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785051113) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 480.003ms - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 10s264ms - TotalThreadsInvoluntaryContextSwitches: 887 (887) - TotalThreadsTotalWallClockTime: 9m18s - TotalThreadsSysTime: 24s784ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 540.47K (540467) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 43s040ms - ExecTreeOpenTime: 42s120ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17):(Total: 4.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 122.14 KB/sec ; Min: 122.14 KB/sec ; Max: 122.14 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 282.493us ; Min: 157.226us ; Max: 407.761us ; Number of samples: 2) - RpcRecvrTime: (Avg: 39.663us ; Min: 25.336us ; Max: 53.991us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 42s120ms, non-child: 6s388ms, % non-child: 15.17%) Node Lifecycle Event Timeline: 43s044ms - Open Started: 920.003ms (920.003ms) - Open Finished: 43s040ms (42s120ms) - First Batch Requested: 43s040ms (0.000ns) - First Batch Returned: 43s040ms (0.000ns) - Last Batch Returned: 43s040ms (0.000ns) - Closed: 43s044ms (4.000ms) - PeakMemoryUsage: 16.46 MB (17262592) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 35s732ms, non-child: 1s436ms, % non-child: 4.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 43s040ms - Open Started: 920.003ms (920.003ms) - Open Finished: 2s756ms (1s836ms) - First Batch Requested: 2s756ms (0.000ns) - First Batch Returned: 2s768ms (12.000ms) - Last Batch Returned: 43s040ms (40s272ms) - Closed: 43s040ms (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 13.21 MB (13848832) - ProbeRows: 6.29M (6286206) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s416ms - RowsReturned: 8.50K (8496) - RowsReturnedRate: 237.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.28M (6283362) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 924.003ms - Open Started: 920.003ms (920.003ms) - Open Finished: 920.003ms (0.000ns) - First Batch Requested: 920.003ms (0.000ns) - First Batch Returned: 920.003ms (0.000ns) - Last Batch Returned: 920.003ms (0.000ns) - Closed: 924.003ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 19.255us ; Min: 12.414us ; Max: 26.406us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 34s296ms, non-child: 348.001ms, % non-child: 1.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 43s040ms - Open Started: 920.003ms (920.003ms) - Open Finished: 2s756ms (1s836ms) - First Batch Requested: 2s756ms (0.000ns) - First Batch Returned: 2s756ms (0.000ns) - Last Batch Returned: 43s040ms (40s284ms) - Closed: 43s040ms (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 13.20 MB (13836544) - ProbeRows: 6.31M (6305156) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 324.001ms - RowsReturned: 6.29M (6286206) - RowsReturnedRate: 183.29 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.29M (6287706) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 924.003ms - Open Started: 920.003ms (920.003ms) - Open Finished: 920.003ms (0.000ns) - First Batch Requested: 920.003ms (0.000ns) - First Batch Returned: 920.003ms (0.000ns) - Last Batch Returned: 920.003ms (0.000ns) - Closed: 924.003ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 25.967us ; Min: 22.972us ; Max: 28.963us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 33s948ms, non-child: 988.005ms, % non-child: 2.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 43s040ms - Open Started: 920.003ms (920.003ms) - Open Finished: 2s756ms (1s836ms) - First Batch Requested: 2s756ms (0.000ns) - First Batch Returned: 2s756ms (0.000ns) - Last Batch Returned: 43s040ms (40s284ms) - Closed: 43s040ms (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 320.001ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 166.04 MB (174108928) - ProbeRows: 6.35M (6345776) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 956.005ms - RowsReturned: 6.31M (6305156) - RowsReturnedRate: 185.73 K/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 228.000ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 92.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.23M (8225956) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 64.000ms, non-child: 4.000ms, % non-child: 6.25%) Node Lifecycle Event Timeline: 1s304ms - Open Started: 920.003ms (920.003ms) - Open Finished: 920.003ms (0.000ns) - First Batch Requested: 920.003ms (0.000ns) - First Batch Returned: 920.003ms (0.000ns) - Last Batch Returned: 1s212ms (292.001ms) - Closed: 1s304ms (92.000ms) - ConvertRowBatchTime: 4.000ms - PeakMemoryUsage: 14.22 MB (14907159) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 30.01 M/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 64.54 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 60.000ms - DataWaitTime: 60.000ms Enqueue: - BytesReceived (500.000ms): 4.75 MB, 4.75 MB, 29.60 MB - DeferredQueueSize (500.000ms): 8, 8, 0 - DispatchTime: (Avg: 19.543us ; Min: 5.742us ; Max: 121.297us ; Number of samples: 1881) - DeserializeRowBatchTime: 92.000ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 887.807ms - TotalRPCsDeferred: 9 (9) HASH_JOIN_NODE (id=7):(Total: 32s960ms, non-child: 264.001ms, % non-child: 0.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 43s040ms - Open Started: 920.003ms (920.003ms) - Open Finished: 2s756ms (1s836ms) - First Batch Requested: 2s756ms (0.000ns) - First Batch Returned: 2s756ms (0.000ns) - Last Batch Returned: 43s040ms (40s284ms) - Closed: 43s040ms (0.000ns) - BuildRows: 365 (365) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 7.97 MB (8360192) - ProbeRows: 6.35M (6345776) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 248.001ms - RowsReturned: 6.35M (6345776) - RowsReturnedRate: 192.53 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.35M (6346141) - Resizes: 0 (0) - Travel: 2.50M (2497604) EXCHANGE_NODE (id=13): Node Lifecycle Event Timeline: 924.003ms - Open Started: 920.003ms (920.003ms) - Open Finished: 920.003ms (0.000ns) - First Batch Requested: 924.003ms (4.000ms) - First Batch Returned: 924.003ms (0.000ns) - Last Batch Returned: 924.003ms (0.000ns) - Closed: 924.003ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 22.898us ; Min: 22.898us ; Max: 22.898us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 32s696ms, non-child: 29s220ms, % non-child: 89.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 43s040ms - Open Started: 920.003ms (920.003ms) - Open Finished: 2s748ms (1s828ms) - First Batch Requested: 2s748ms (0.000ns) - First Batch Returned: 2s756ms (8.000ms) - Last Batch Returned: 43s040ms (40s284ms) - Closed: 43s040ms (0.000ns) - BuildRows: 9.17M (9173330) - BuildTime: 1s280ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 544.89M (544892390) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s756ms - RowsReturned: 6.35M (6345776) - RowsReturnedRate: 194.08 K/sec Buffer pool: - AllocTime: 8.000ms - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 840.006ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 436.003ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 541.28M (541280207) - Resizes: 0 (0) - Travel: 356.55M (356545644) EXCHANGE_NODE (id=12):(Total: 500.004ms, non-child: 96.000ms, % non-child: 19.20%) Node Lifecycle Event Timeline: 2s700ms - Open Started: 920.003ms (920.003ms) - Open Finished: 920.003ms (0.000ns) - First Batch Requested: 924.003ms (4.000ms) - First Batch Returned: 924.003ms (0.000ns) - Last Batch Returned: 2s264ms (1s340ms) - Closed: 2s700ms (436.003ms) - ConvertRowBatchTime: 80.000ms - PeakMemoryUsage: 13.07 MB (13708234) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 18.35 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 58.68 MB, 241.32 MB, 437.77 MB, 489.91 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 420.003ms - DataWaitTime: 404.003ms Enqueue: - BytesReceived (500.000ms): 2.64 MB, 4.50 MB, 25.61 MB, 105.15 MB, 190.70 MB, 213.42 MB - DeferredQueueSize (500.000ms): 0, 7, 0, 0, 0, 0 - DispatchTime: (Avg: 16.163us ; Min: 5.701us ; Max: 153.500us ; Number of samples: 8969) - DeserializeRowBatchTime: 444.003ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 809.907ms - TotalRPCsDeferred: 9 (9) HDFS_SCAN_NODE (id=0):(Total: 2s976ms, non-child: 2s976ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:597/139.06 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: All filters arrived. Waited 0. Maximum arrival delay: 2s263ms. Hdfs Read Thread Concurrency Bucket: 0:69.05% 1:26.19% 2:3.571% 3:1.19% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:116 PARQUET/Unknown(Skipped):481 Node Lifecycle Event Timeline: 43s040ms - Open Started: 920.003ms (920.003ms) - Open Finished: 920.003ms (0.000ns) - First Batch Requested: 2s700ms (1s780ms) - First Batch Returned: 2s748ms (48.000ms) - Last Batch Returned: 43s036ms (40s288ms) - Closed: 43s040ms (4.000ms) - BytesRead (1s000ms): 0, 0, 0, 684.68 MB, 777.99 MB, 1.01 GB, 1.22 GB, 1.61 GB, 1.91 GB, 2.09 GB, 2.33 GB, 2.55 GB, 2.93 GB, 3.17 GB, 3.29 GB, 3.53 GB, 3.81 GB, 4.08 GB, 4.40 GB, 4.52 GB, 4.80 GB, 5.07 GB, 5.39 GB, 5.55 GB, 5.90 GB, 6.12 GB, 6.33 GB, 6.65 GB, 6.83 GB, 7.07 GB, 7.40 GB, 7.58 GB, 7.92 GB, 8.10 GB, 8.37 GB, 8.68 GB, 8.85 GB, 9.17 GB, 9.34 GB, 9.64 GB, 9.95 GB, 10.10 GB, 10.26 GB - FooterProcessingTime: (Avg: 137.932us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 116) - InitialRangeActualReservation: (Avg: 56.41 MB (59154149) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 116) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 116) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1215314309) ; Min: 471.51 MB (494415811) ; Max: 2.00 GB (2148389721) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.69 KB (41666) ; Min: 11.00 B (11) ; Max: 70.31 KB (71999) ; Number of samples: 262511) - ParquetRowGroupActualReservation: (Avg: 58.48 MB (61323617) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 116) - ParquetRowGroupIdealReservation: (Avg: 118.83 MB (124599755) ; Min: 88.00 MB (92274688) ; Max: 144.00 MB (150994944) ; Number of samples: 116) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1929726848) ; Min: 484.44 MB (507973063) ; Max: 3.66 GB (3933792404) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.61 KB (66159) ; Min: 9.00 B (9) ; Max: 71.14 KB (72850) ; Number of samples: 262511) - AverageHdfsReadThreadConcurrency: 0.37 - AverageScannerThreadConcurrency: 12.14 - BytesRead: 10.31 GB (11072997104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 3.98K (3976) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.25 GB (11001125513) - DataCacheHitCount: 3.92K (3922) - DataCacheMissBytes: 68.54 MB (71871591) - DataCacheMissCount: 55 (55) - DataCachePartialHitCount: 19 (19) - DecompressionTime: 8s784ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 262.51K (262511) - NumRowGroups: 116 (116) - NumRowGroupsWithPageIndex: 116 (116) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 799.34 MB (838171790) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 679.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.47 GB (33792851968) - RowBatchQueueGetWaitTime: 104.000ms - RowBatchQueuePeakMemoryUsage: 6.48 MB (6793216) - RowBatchQueuePutWaitTime: 7m5s - RowBatchesEnqueued: 532.38K (532380) - RowsRead: 544.97M (544974189) - RowsReturned: 544.89M (544892390) - RowsReturnedRate: 183.09 M/sec - ScanRangesComplete: 597 (597) - ScannerIoWaitTime: 10s264ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 811 (811) - ScannerThreadsTotalWallClockTime: 8m32s - ScannerThreadsSysTime: 16s492ms - ScannerThreadsUserTime: 1m3s - ScannerThreadsVoluntaryContextSwitches: 535.46K (535462) - TotalRawHdfsOpenFileTime(*): 40.000ms - TotalRawHdfsReadTime(*): 15s540ms - TotalReadThroughput: 244.86 MB/sec Buffer pool: - AllocTime: 528.003ms - CumulativeAllocationBytes: 6.24 GB (6697058304) - CumulativeAllocations: 1.29K (1291) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 724.00 MB (759169024) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 528.003ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1982343) - Rows rejected: 46.52K (46522) - Rows total: 544.97M (544974189) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935821) - Rows rejected: 23.57K (23567) - Rows total: 544.93M (544927667) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.91M (1912254) - Rows rejected: 11.71K (11710) - Rows total: 544.90M (544904100) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 597 (597) - Files rejected: 481 (481) - Files total: 597 (597) - RowGroups processed: 532.15K (532148) - RowGroups rejected: 0 (0) - RowGroups total: 532.15K (532148) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 544.89M (544892390) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 544.89M (544892390) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 920.003ms, non-child: 920.003ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 920.003ms - CodegenSysTime: 7.990ms - CodegenUserTime: 910.946ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 280.001ms - IrGenerationTime: 28.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 596.002ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 16.000ms Instance 2a45c19935b2f933:e73e987000000019 (host=impala-executor-000-1:22000):(Total: 43s032ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:13.867 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:604/139.24 GB Filter 0 arrival: 964ms Filter 2 arrival: 964ms Filter 6 arrival: 964ms Filter 4 arrival: 1s212ms Filter 8 arrival: 2s268ms Fragment Instance Lifecycle Event Timeline: 43s032ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 43s032ms (43s028ms) - First Batch Produced: 43s032ms (0.000ns) - First Batch Sent: 43s032ms (0.000ns) - ExecInternal Finished: 43s032ms (0.000ns) - MemoryUsage (1s000ms): 38.54 MB, 433.29 MB, 1.18 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.55 GB, 1.49 GB, 1.33 GB - ThreadUsage (1s000ms): 1, 2, 8, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 11, 10, 7 - AverageThreadTokens: 12.97 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1785503700) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785503700) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 60.000ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 7s340ms - TotalThreadsInvoluntaryContextSwitches: 868 (868) - TotalThreadsTotalWallClockTime: 9m16s - TotalThreadsSysTime: 24s760ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 537.50K (537498) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 43s028ms - ExecTreeOpenTime: 42s072ms - PrepareTime: 4.000ms - ExecTreePrepareTime: 4.000ms KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 124.32 KB/sec ; Min: 124.32 KB/sec ; Max: 124.32 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 253.831us ; Min: 107.061us ; Max: 400.602us ; Number of samples: 2) - RpcRecvrTime: (Avg: 46.894us ; Min: 20.248us ; Max: 73.540us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 42s076ms, non-child: 6s348ms, % non-child: 15.09%) Node Lifecycle Event Timeline: 43s032ms - Open Started: 960.002ms (960.002ms) - Open Finished: 43s032ms (42s072ms) - First Batch Requested: 43s032ms (0.000ns) - First Batch Returned: 43s032ms (0.000ns) - Last Batch Returned: 43s032ms (0.000ns) - Closed: 43s032ms (0.000ns) - PeakMemoryUsage: 16.46 MB (17262592) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 35s728ms, non-child: 1s468ms, % non-child: 4.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 43s032ms - Open Started: 960.002ms (960.002ms) - Open Finished: 2s792ms (1s832ms) - First Batch Requested: 2s792ms (0.000ns) - First Batch Returned: 2s816ms (24.000ms) - Last Batch Returned: 43s032ms (40s216ms) - Closed: 43s032ms (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 12.78 MB (13404416) - ProbeRows: 6.29M (6289404) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s448ms - RowsReturned: 8.64K (8640) - RowsReturnedRate: 241.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.29M (6286452) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 964.002ms - Open Started: 960.002ms (960.002ms) - Open Finished: 960.002ms (0.000ns) - First Batch Requested: 960.002ms (0.000ns) - First Batch Returned: 960.002ms (0.000ns) - Last Batch Returned: 960.002ms (0.000ns) - Closed: 964.002ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 22.079us ; Min: 12.076us ; Max: 34.083us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 34s260ms, non-child: 492.001ms, % non-child: 1.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 43s032ms - Open Started: 960.002ms (960.002ms) - Open Finished: 2s792ms (1s832ms) - First Batch Requested: 2s792ms (0.000ns) - First Batch Returned: 2s792ms (0.000ns) - Last Batch Returned: 43s032ms (40s240ms) - Closed: 43s032ms (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 12.77 MB (13392128) - ProbeRows: 6.31M (6308964) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 476.001ms - RowsReturned: 6.29M (6289404) - RowsReturnedRate: 183.58 K/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 4.000ms - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.29M (6290904) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 964.002ms - Open Started: 960.002ms (960.002ms) - Open Finished: 960.002ms (0.000ns) - First Batch Requested: 960.002ms (0.000ns) - First Batch Returned: 960.002ms (0.000ns) - Last Batch Returned: 964.002ms (4.000ms) - Closed: 964.002ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 27.289us ; Min: 22.316us ; Max: 32.262us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 33s768ms, non-child: 1s024ms, % non-child: 3.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 43s032ms - Open Started: 960.002ms (960.002ms) - Open Finished: 2s792ms (1s832ms) - First Batch Requested: 2s792ms (0.000ns) - First Batch Returned: 2s792ms (0.000ns) - Last Batch Returned: 43s032ms (40s240ms) - Closed: 43s032ms (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 316.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 167.50 MB (175636736) - ProbeRows: 6.35M (6348164) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s016ms - RowsReturned: 6.31M (6308964) - RowsReturnedRate: 186.83 K/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 212.000ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 100.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.23M (8229764) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 36.000ms, non-child: 20.000ms, % non-child: 55.56%) Node Lifecycle Event Timeline: 1s312ms - Open Started: 960.002ms (960.002ms) - Open Finished: 960.002ms (0.000ns) - First Batch Requested: 964.002ms (4.000ms) - First Batch Returned: 964.002ms (0.000ns) - Last Batch Returned: 1s212ms (248.000ms) - Closed: 1s312ms (100.000ms) - ConvertRowBatchTime: 16.000ms - PeakMemoryUsage: 14.29 MB (14980082) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 53.36 M/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 16.000ms - DataWaitTime: 16.000ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 4.79 MB - DeferredQueueSize (500.000ms): 10, 10 - DispatchTime: (Avg: 20.871us ; Min: 7.212us ; Max: 171.474us ; Number of samples: 1881) - DeserializeRowBatchTime: 108.000ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 926.809ms - TotalRPCsDeferred: 17 (17) HASH_JOIN_NODE (id=7):(Total: 32s744ms, non-child: 300.000ms, % non-child: 0.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 43s032ms - Open Started: 960.002ms (960.002ms) - Open Finished: 2s792ms (1s832ms) - First Batch Requested: 2s792ms (0.000ns) - First Batch Returned: 2s792ms (0.000ns) - Last Batch Returned: 43s032ms (40s240ms) - Closed: 43s032ms (0.000ns) - BuildRows: 365 (365) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 7.92 MB (8304896) - ProbeRows: 6.35M (6348164) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 288.000ms - RowsReturned: 6.35M (6348164) - RowsReturnedRate: 193.87 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.35M (6348529) - Resizes: 0 (0) - Travel: 2.35M (2353081) EXCHANGE_NODE (id=13): Node Lifecycle Event Timeline: 964.002ms - Open Started: 960.002ms (960.002ms) - Open Finished: 960.002ms (0.000ns) - First Batch Requested: 964.002ms (4.000ms) - First Batch Returned: 964.002ms (0.000ns) - Last Batch Returned: 964.002ms (0.000ns) - Closed: 964.002ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 17.510us ; Min: 17.510us ; Max: 17.510us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 32s444ms, non-child: 29s432ms, % non-child: 90.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 43s032ms - Open Started: 960.002ms (960.002ms) - Open Finished: 2s784ms (1s824ms) - First Batch Requested: 2s784ms (0.000ns) - First Batch Returned: 2s792ms (8.000ms) - Last Batch Returned: 43s032ms (40s240ms) - Closed: 43s032ms (0.000ns) - BuildRows: 9.17M (9173330) - BuildTime: 1s600ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 545.34M (545344108) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s624ms - RowsReturned: 6.35M (6348164) - RowsReturnedRate: 195.66 K/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 1s132ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 464.001ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 541.69M (541690283) - Resizes: 0 (0) - Travel: 357.24M (357240246) EXCHANGE_NODE (id=12):(Total: 148.000ms, non-child: 148.000ms, % non-child: 100.00%) Node Lifecycle Event Timeline: 2s732ms - Open Started: 960.002ms (960.002ms) - Open Finished: 960.002ms (0.000ns) - First Batch Requested: 964.002ms (4.000ms) - First Batch Returned: 964.002ms (0.000ns) - Last Batch Returned: 2s268ms (1s304ms) - Closed: 2s732ms (464.001ms) - ConvertRowBatchTime: 104.000ms - PeakMemoryUsage: 13.16 MB (13800445) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 61.98 M/sec Buffer pool: - AllocTime: 16.000ms - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 13.01 MB (13639680) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 13.01 MB (13639680) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 121.68 MB, 310.39 MB, 489.91 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 36.000ms - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 4.50 MB, 4.50 MB, 57.48 MB, 139.69 MB, 213.42 MB - DeferredQueueSize (500.000ms): 7, 7, 6, 6, 0 - DispatchTime: (Avg: 18.813us ; Min: 6.542us ; Max: 283.945us ; Number of samples: 8969) - DeserializeRowBatchTime: 448.001ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 1s892ms - TotalRPCsDeferred: 7.26K (7263) HDFS_SCAN_NODE (id=0):(Total: 2s864ms, non-child: 2s864ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:604/139.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 113 out of 113 Runtime filters: All filters arrived. Waited 0. Maximum arrival delay: 2s268ms. Hdfs Read Thread Concurrency Bucket: 0:78.57% 1:21.43% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:113 PARQUET/Unknown(Skipped):491 Node Lifecycle Event Timeline: 43s032ms - Open Started: 960.002ms (960.002ms) - Open Finished: 960.002ms (0.000ns) - First Batch Requested: 2s732ms (1s772ms) - First Batch Returned: 2s784ms (52.000ms) - Last Batch Returned: 43s024ms (40s240ms) - Closed: 43s032ms (8.000ms) - BytesRead (1s000ms): 0, 0, 339.26 MB, 694.77 MB, 847.74 MB, 1.01 GB, 1.24 GB, 1.59 GB, 1.92 GB, 2.08 GB, 2.33 GB, 2.48 GB, 2.91 GB, 3.14 GB, 3.34 GB, 3.57 GB, 3.91 GB, 4.28 GB, 4.41 GB, 4.61 GB, 4.93 GB, 5.18 GB, 5.52 GB, 5.67 GB, 5.87 GB, 6.22 GB, 6.55 GB, 6.75 GB, 6.95 GB, 7.12 GB, 7.52 GB, 7.77 GB, 7.95 GB, 8.18 GB, 8.44 GB, 8.84 GB, 9.04 GB, 9.27 GB, 9.44 GB, 9.78 GB, 10.06 GB, 10.17 GB, 10.28 GB - FooterProcessingTime: (Avg: 106.194us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 113) - InitialRangeActualReservation: (Avg: 56.85 MB (59611081) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 113) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 113) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1215216797) ; Min: 471.87 MB (494794962) ; Max: 2.00 GB (2150538827) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.61 KB (41583) ; Min: 11.00 B (11) ; Max: 70.28 KB (71968) ; Number of samples: 263013) - ParquetRowGroupActualReservation: (Avg: 58.97 MB (61838145) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 113) - ParquetRowGroupIdealReservation: (Avg: 121.98 MB (127907713) ; Min: 88.00 MB (92274688) ; Max: 144.00 MB (150994944) ; Number of samples: 113) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1933227085) ; Min: 484.80 MB (508351277) ; Max: 3.68 GB (3946555717) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.60 KB (66152) ; Min: 9.00 B (9) ; Max: 71.27 KB (72977) ; Number of samples: 263013) - AverageHdfsReadThreadConcurrency: 0.21 - AverageScannerThreadConcurrency: 12.21 - BytesRead: 10.31 GB (11068797397) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 3.94K (3937) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.28 GB (11034104253) - DataCacheHitCount: 3.91K (3913) - DataCacheMissBytes: 33.09 MB (34693144) - DataCacheMissCount: 25 (25) - DataCachePartialHitCount: 22 (22) - DecompressionTime: 8s508ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 263.01K (263013) - NumRowGroups: 113 (113) - NumRowGroupsWithPageIndex: 113 (113) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 799.87 MB (838721937) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 981.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.50 GB (33820456960) - RowBatchQueueGetWaitTime: 80.000ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 7m7s - RowBatchesEnqueued: 532.81K (532812) - RowsRead: 545.42M (545424005) - RowsReturned: 545.34M (545344108) - RowsReturnedRate: 190.41 M/sec - ScanRangesComplete: 604 (604) - ScannerIoWaitTime: 7s340ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 790 (790) - ScannerThreadsTotalWallClockTime: 8m31s - ScannerThreadsSysTime: 16s613ms - ScannerThreadsUserTime: 1m2s - ScannerThreadsVoluntaryContextSwitches: 536.70K (536695) - TotalRawHdfsOpenFileTime(*): 60.000ms - TotalRawHdfsReadTime(*): 10s752ms - TotalReadThroughput: 245.42 MB/sec Buffer pool: - AllocTime: 616.001ms - CumulativeAllocationBytes: 6.16 GB (6615597056) - CumulativeAllocations: 1.27K (1267) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 724.00 MB (759169024) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 616.001ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1931289) - Rows rejected: 45.75K (45749) - Rows total: 545.42M (545424005) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.89M (1885540) - Rows rejected: 22.72K (22716) - Rows total: 545.38M (545378256) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.86M (1862824) - Rows rejected: 11.43K (11432) - Rows total: 545.36M (545355540) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 604 (604) - Files rejected: 491 (491) - Files total: 604 (604) - RowGroups processed: 532.59K (532586) - RowGroups rejected: 0 (0) - RowGroups total: 532.59K (532586) - Rows processed: 1.85M (1851392) - Rows rejected: 0 (0) - Rows total: 545.34M (545344108) - Splits processed: 113 (113) - Splits rejected: 0 (0) - Splits total: 113 (113) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.85M (1851392) - Rows rejected: 0 (0) - Rows total: 545.34M (545344108) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 956.002ms, non-child: 956.002ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 3 (3) - CodegenTotalWallClockTime: 956.002ms - CodegenSysTime: 8.007ms - CodegenUserTime: 942.833ms - CodegenVoluntaryContextSwitches: 22 (22) - CompileTime: 300.000ms - IrGenerationTime: 32.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 612.001ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 12.000ms Instance 2a45c19935b2f933:e73e987000000017 (host=impala-executor-000-6:22000):(Total: 42s415ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:13.251 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:596/139.02 GB Filter 0 arrival: 950ms Filter 2 arrival: 950ms Filter 6 arrival: 950ms Filter 4 arrival: 1s213ms Filter 8 arrival: 2s266ms Fragment Instance Lifecycle Event Timeline: 42s415ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 42s415ms (42s415ms) - First Batch Produced: 42s415ms (0.000ns) - First Batch Sent: 42s415ms (0.000ns) - ExecInternal Finished: 42s415ms (0.000ns) - MemoryUsage (1s000ms): 38.54 MB, 433.12 MB, 1.17 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.64 GB, 1.32 GB - ThreadUsage (1s000ms): 1, 2, 8, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 8 - AverageThreadTokens: 12.98 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1786176933) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1786176933) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 267.998ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s067ms - TotalThreadsInvoluntaryContextSwitches: 913 (913) - TotalThreadsTotalWallClockTime: 9m10s - TotalThreadsSysTime: 24s615ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 537.68K (537676) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 42s415ms - ExecTreeOpenTime: 41s471ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 119.08 KB/sec ; Min: 119.08 KB/sec ; Max: 119.08 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 249.734us ; Min: 114.023us ; Max: 385.445us ; Number of samples: 2) - RpcRecvrTime: (Avg: 44.733us ; Min: 16.927us ; Max: 72.539us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 47.00 B (47) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 41s471ms, non-child: 6s295ms, % non-child: 15.18%) Node Lifecycle Event Timeline: 42s415ms - Open Started: 943.994ms (943.994ms) - Open Finished: 42s415ms (41s471ms) - First Batch Requested: 42s415ms (0.000ns) - First Batch Returned: 42s415ms (0.000ns) - Last Batch Returned: 42s415ms (0.000ns) - Closed: 42s415ms (0.000ns) - PeakMemoryUsage: 16.40 MB (17199104) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 3.999ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 35s175ms, non-child: 1s447ms, % non-child: 4.12%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 42s415ms - Open Started: 943.994ms (943.994ms) - Open Finished: 2s787ms (1s843ms) - First Batch Requested: 2s787ms (0.000ns) - First Batch Returned: 2s811ms (23.999ms) - Last Batch Returned: 42s415ms (39s603ms) - Closed: 42s415ms (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 15.88 MB (16646400) - ProbeRows: 6.28M (6281495) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s431ms - RowsReturned: 8.85K (8845) - RowsReturnedRate: 251.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.28M (6279019) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 947.994ms - Open Started: 943.994ms (943.994ms) - Open Finished: 943.994ms (0.000ns) - First Batch Requested: 947.994ms (3.999ms) - First Batch Returned: 947.994ms (0.000ns) - Last Batch Returned: 947.994ms (0.000ns) - Closed: 947.994ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 20.370us ; Min: 14.751us ; Max: 30.699us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 33s727ms, non-child: 347.996ms, % non-child: 1.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 42s415ms - Open Started: 943.994ms (943.994ms) - Open Finished: 2s787ms (1s843ms) - First Batch Requested: 2s787ms (0.000ns) - First Batch Returned: 2s787ms (0.000ns) - Last Batch Returned: 42s415ms (39s627ms) - Closed: 42s415ms (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 15.86 MB (16634112) - ProbeRows: 6.30M (6301386) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 335.997ms - RowsReturned: 6.28M (6281495) - RowsReturnedRate: 186.24 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.28M (6282995) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 947.994ms - Open Started: 943.994ms (943.994ms) - Open Finished: 943.994ms (0.000ns) - First Batch Requested: 947.994ms (3.999ms) - First Batch Returned: 947.994ms (0.000ns) - Last Batch Returned: 947.994ms (0.000ns) - Closed: 947.994ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 23.286us ; Min: 21.158us ; Max: 25.415us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 33s379ms, non-child: 955.991ms, % non-child: 2.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 42s415ms - Open Started: 943.994ms (943.994ms) - Open Finished: 2s787ms (1s843ms) - First Batch Requested: 2s787ms (0.000ns) - First Batch Returned: 2s787ms (0.000ns) - Last Batch Returned: 42s415ms (39s627ms) - Closed: 42s415ms (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 279.998ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 169.01 MB (177223936) - ProbeRows: 6.34M (6340352) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 943.992ms - RowsReturned: 6.30M (6301386) - RowsReturnedRate: 188.78 K/sec Buffer pool: - AllocTime: 3.999ms - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 183.998ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 91.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.22M (8222186) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 75.999ms, non-child: 27.999ms, % non-child: 36.84%) Node Lifecycle Event Timeline: 1s303ms - Open Started: 943.994ms (943.994ms) - Open Finished: 943.994ms (0.000ns) - First Batch Requested: 947.994ms (3.999ms) - First Batch Returned: 947.994ms (0.000ns) - Last Batch Returned: 1s211ms (263.998ms) - Closed: 1s303ms (91.999ms) - ConvertRowBatchTime: 23.999ms - PeakMemoryUsage: 14.26 MB (14955843) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 25.27 M/sec Buffer pool: - AllocTime: 11.999ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 51.999ms - DataWaitTime: 47.999ms Enqueue: - BytesReceived (500.000ms): 4.77 MB, 4.77 MB - DeferredQueueSize (500.000ms): 9, 9 - DispatchTime: (Avg: 21.569us ; Min: 8.217us ; Max: 938.074us ; Number of samples: 1881) - DeserializeRowBatchTime: 107.999ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 910.837ms - TotalRPCsDeferred: 12 (12) HASH_JOIN_NODE (id=7):(Total: 32s423ms, non-child: 339.997ms, % non-child: 1.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 42s415ms - Open Started: 943.994ms (943.994ms) - Open Finished: 2s787ms (1s843ms) - First Batch Requested: 2s787ms (0.000ns) - First Batch Returned: 2s787ms (0.000ns) - Last Batch Returned: 42s415ms (39s627ms) - Closed: 42s415ms (0.000ns) - BuildRows: 365 (365) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 7.97 MB (8360192) - ProbeRows: 6.34M (6340352) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 339.997ms - RowsReturned: 6.34M (6340352) - RowsReturnedRate: 195.55 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.34M (6340717) - Resizes: 0 (0) - Travel: 2.02M (2017613) EXCHANGE_NODE (id=13): Node Lifecycle Event Timeline: 947.994ms - Open Started: 943.994ms (943.994ms) - Open Finished: 943.994ms (0.000ns) - First Batch Requested: 947.994ms (3.999ms) - First Batch Returned: 947.994ms (0.000ns) - Last Batch Returned: 947.994ms (0.000ns) - Closed: 947.994ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 14.729us ; Min: 14.729us ; Max: 14.729us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 32s083ms, non-child: 28s767ms, % non-child: 89.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 42s415ms - Open Started: 943.994ms (943.994ms) - Open Finished: 2s779ms (1s835ms) - First Batch Requested: 2s779ms (0.000ns) - First Batch Returned: 2s787ms (7.999ms) - Last Batch Returned: 42s415ms (39s627ms) - Closed: 42s415ms (0.000ns) - BuildRows: 9.17M (9173330) - BuildTime: 1s455ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 544.32M (544322359) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27s171ms - RowsReturned: 6.34M (6340352) - RowsReturnedRate: 197.62 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 987.994ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 463.997ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 540.74M (540744238) - Resizes: 0 (0) - Travel: 356.62M (356617522) EXCHANGE_NODE (id=12):(Total: 315.998ms, non-child: 115.999ms, % non-child: 36.71%) Node Lifecycle Event Timeline: 2s727ms - Open Started: 943.994ms (943.994ms) - Open Finished: 943.994ms (0.000ns) - First Batch Requested: 947.994ms (3.999ms) - First Batch Returned: 947.994ms (0.000ns) - Last Batch Returned: 2s263ms (1s315ms) - Closed: 2s727ms (463.997ms) - ConvertRowBatchTime: 95.999ms - PeakMemoryUsage: 13.14 MB (13783445) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 29.03 M/sec Buffer pool: - AllocTime: 7.999ms - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 136.23 MB, 324.44 MB, 489.91 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 207.998ms - DataWaitTime: 199.998ms Enqueue: - BytesReceived (500.000ms): 4.53 MB, 4.53 MB, 59.37 MB, 141.36 MB, 213.42 MB - DeferredQueueSize (500.000ms): 8, 8, 0, 0, 0 - DispatchTime: (Avg: 19.253us ; Min: 5.136us ; Max: 2.440ms ; Number of samples: 8969) - DeserializeRowBatchTime: 475.997ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 833.900ms - TotalRPCsDeferred: 12 (12) HDFS_SCAN_NODE (id=0):(Total: 2s999ms, non-child: 2s999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:596/139.02 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: All filters arrived. Waited 0. Maximum arrival delay: 2s266ms. Hdfs Read Thread Concurrency Bucket: 0:91.57% 1:7.229% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:1.205% File Formats: PARQUET/SNAPPY:115 PARQUET/Unknown(Skipped):481 Node Lifecycle Event Timeline: 42s415ms - Open Started: 943.994ms (943.994ms) - Open Finished: 947.994ms (3.999ms) - First Batch Requested: 2s727ms (1s779ms) - First Batch Returned: 2s779ms (51.999ms) - Last Batch Returned: 42s407ms (39s627ms) - Closed: 42s415ms (7.999ms) - BytesRead (1s000ms): 0, 0, 343.21 MB, 703.92 MB, 867.13 MB, 1.05 GB, 1.17 GB, 1.57 GB, 1.88 GB, 2.07 GB, 2.23 GB, 2.59 GB, 3.02 GB, 3.15 GB, 3.35 GB, 3.59 GB, 3.88 GB, 4.25 GB, 4.40 GB, 4.61 GB, 4.92 GB, 5.36 GB, 5.52 GB, 5.72 GB, 5.90 GB, 6.30 GB, 6.59 GB, 6.78 GB, 6.96 GB, 7.28 GB, 7.62 GB, 7.89 GB, 8.06 GB, 8.28 GB, 8.57 GB, 8.84 GB, 9.12 GB, 9.30 GB, 9.70 GB, 9.91 GB, 10.09 GB, 10.20 GB - FooterProcessingTime: (Avg: 243.476us ; Min: 0.000ns ; Max: 7.999ms ; Number of samples: 115) - InitialRangeActualReservation: (Avg: 56.70 MB (59449700) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 115) - InitialRangeIdealReservation: (Avg: 127.17 KB (130217) ; Min: 32.00 KB (32768) ; Max: 128.00 KB (131072) ; Number of samples: 115) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1213031657) ; Min: 471.01 MB (493890952) ; Max: 2.00 GB (2146371695) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.61 KB (41588) ; Min: 11.00 B (11) ; Max: 69.82 KB (71499) ; Number of samples: 262507) - ParquetRowGroupActualReservation: (Avg: 58.78 MB (61638032) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 115) - ParquetRowGroupIdealReservation: (Avg: 120.60 MB (126460616) ; Min: 72.00 KB (73728) ; Max: 144.00 MB (150994944) ; Number of samples: 115) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1929301361) ; Min: 483.92 MB (507428402) ; Max: 3.67 GB (3938598103) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.59 KB (66145) ; Min: 9.00 B (9) ; Max: 70.67 KB (72368) ; Number of samples: 262507) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 12.23 - BytesRead: 10.29 GB (11049700870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4.16K (4156) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.28 GB (11032769630) - DataCacheHitCount: 4.15K (4152) - DataCacheMissBytes: 16.15 MB (16931240) - DataCacheMissCount: 4 (4) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8s815ms - MaterializeTupleTime(*): 1m4s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 262.51K (262507) - NumRowGroups: 115 (115) - NumRowGroupsWithPageIndex: 115 (115) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 800.61 MB (839502073) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 1.60 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.44 GB (33757231104) - RowBatchQueueGetWaitTime: 131.999ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 7m5s - RowBatchesEnqueued: 531.82K (531819) - RowsRead: 544.40M (544402237) - RowsReturned: 544.32M (544322359) - RowsReturnedRate: 181.44 M/sec - ScanRangesComplete: 596 (596) - ScannerIoWaitTime: 2s067ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 806 (806) - ScannerThreadsTotalWallClockTime: 8m25s - ScannerThreadsSysTime: 16s561ms - ScannerThreadsUserTime: 1m2s - ScannerThreadsVoluntaryContextSwitches: 533.81K (533813) - TotalRawHdfsOpenFileTime(*): 15.999ms - TotalRawHdfsReadTime(*): 6s439ms - TotalReadThroughput: 247.95 MB/sec Buffer pool: - AllocTime: 563.996ms - CumulativeAllocationBytes: 6.05 GB (6493642752) - CumulativeAllocations: 1.30K (1302) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 722.00 MB (757071872) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 563.996ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1947851) - Rows rejected: 45.50K (45498) - Rows total: 544.40M (544402237) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.90M (1902353) - Rows rejected: 23.01K (23014) - Rows total: 544.36M (544356739) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.88M (1879339) - Rows rejected: 11.37K (11366) - Rows total: 544.33M (544333725) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 596 (596) - Files rejected: 481 (481) - Files total: 596 (596) - RowGroups processed: 531.59K (531589) - RowGroups rejected: 0 (0) - RowGroups total: 531.59K (531589) - Rows processed: 1.87M (1867973) - Rows rejected: 0 (0) - Rows total: 544.32M (544322359) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.87M (1867973) - Rows rejected: 0 (0) - Rows total: 544.32M (544322359) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 943.994ms, non-child: 943.994ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 5 (5) - CodegenTotalWallClockTime: 943.994ms - CodegenSysTime: 19.977ms - CodegenUserTime: 922.399ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 287.998ms - IrGenerationTime: 27.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 607.996ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 15.999ms Instance 2a45c19935b2f933:e73e98700000001e (host=impala-executor-000-9:22000):(Total: 41s692ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:12.528 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:603/138.82 GB Filter 0 arrival: 977ms Filter 2 arrival: 977ms Filter 6 arrival: 977ms Filter 4 arrival: 1s213ms Filter 8 arrival: 2s265ms Fragment Instance Lifecycle Event Timeline: 41s692ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 41s692ms (41s688ms) - First Batch Produced: 41s692ms (0.000ns) - First Batch Sent: 41s692ms (0.000ns) - ExecInternal Finished: 41s692ms (0.000ns) - MemoryUsage (1s000ms): 38.56 MB, 376.20 MB, 785.12 MB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.57 GB, 1.48 GB - ThreadUsage (1s000ms): 1, 2, 2, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 12 - AverageThreadTokens: 12.98 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1784851616) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1784851616) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 324.002ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4s612ms - TotalThreadsInvoluntaryContextSwitches: 911 (911) - TotalThreadsTotalWallClockTime: 9m1s - TotalThreadsSysTime: 24s660ms - TotalThreadsUserTime: 1m36s - TotalThreadsVoluntaryContextSwitches: 541.00K (540997) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 41s688ms - ExecTreeOpenTime: 40s720ms - PrepareTime: 4.000ms - ExecTreePrepareTime: 4.000ms KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 126.37 KB/sec ; Min: 126.37 KB/sec ; Max: 126.37 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 233.433us ; Min: 95.919us ; Max: 370.947us ; Number of samples: 2) - RpcRecvrTime: (Avg: 43.308us ; Min: 16.199us ; Max: 70.418us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 48.00 B (48) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 40s724ms, non-child: 6s364ms, % non-child: 15.63%) Node Lifecycle Event Timeline: 41s692ms - Open Started: 972.006ms (972.006ms) - Open Finished: 41s692ms (40s720ms) - First Batch Requested: 41s692ms (0.000ns) - First Batch Returned: 41s692ms (0.000ns) - Last Batch Returned: 41s692ms (0.000ns) - Closed: 41s692ms (0.000ns) - PeakMemoryUsage: 18.59 MB (19488768) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 34s360ms, non-child: 1s180ms, % non-child: 3.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s692ms - Open Started: 972.006ms (972.006ms) - Open Finished: 2s780ms (1s808ms) - First Batch Requested: 2s780ms (0.000ns) - First Batch Returned: 2s792ms (12.000ms) - Last Batch Returned: 41s692ms (38s900ms) - Closed: 41s692ms (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 15.45 MB (16201984) - ProbeRows: 6.30M (6295828) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s160ms - RowsReturned: 8.29K (8293) - RowsReturnedRate: 241.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 4.000ms - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.29M (6293258) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 976.006ms - Open Started: 972.006ms (972.006ms) - Open Finished: 972.006ms (0.000ns) - First Batch Requested: 972.006ms (0.000ns) - First Batch Returned: 972.006ms (0.000ns) - Last Batch Returned: 976.006ms (4.000ms) - Closed: 976.006ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 20.958us ; Min: 13.840us ; Max: 36.679us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 33s180ms, non-child: 340.002ms, % non-child: 1.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s692ms - Open Started: 972.006ms (972.006ms) - Open Finished: 2s780ms (1s808ms) - First Batch Requested: 2s780ms (0.000ns) - First Batch Returned: 2s780ms (0.000ns) - Last Batch Returned: 41s692ms (38s912ms) - Closed: 41s692ms (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 15.44 MB (16189696) - ProbeRows: 6.32M (6316566) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 320.002ms - RowsReturned: 6.30M (6295828) - RowsReturnedRate: 189.75 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.30M (6297328) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 976.006ms - Open Started: 972.006ms (972.006ms) - Open Finished: 972.006ms (0.000ns) - First Batch Requested: 976.006ms (4.000ms) - First Batch Returned: 976.006ms (0.000ns) - Last Batch Returned: 976.006ms (0.000ns) - Closed: 976.006ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 17.452us ; Min: 16.152us ; Max: 18.752us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 32s840ms, non-child: 1s004ms, % non-child: 3.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s692ms - Open Started: 972.006ms (972.006ms) - Open Finished: 2s780ms (1s808ms) - First Batch Requested: 2s780ms (0.000ns) - First Batch Returned: 2s780ms (0.000ns) - Last Batch Returned: 41s692ms (38s912ms) - Closed: 41s692ms (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 272.001ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 168.29 MB (176462080) - ProbeRows: 6.35M (6353496) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 996.007ms - RowsReturned: 6.32M (6316566) - RowsReturnedRate: 192.34 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 180.001ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 88.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.24M (8237366) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 56.000ms, non-child: 44.000ms, % non-child: 78.57%) Node Lifecycle Event Timeline: 1s300ms - Open Started: 972.006ms (972.006ms) - Open Finished: 972.006ms (0.000ns) - First Batch Requested: 976.006ms (4.000ms) - First Batch Returned: 976.006ms (0.000ns) - Last Batch Returned: 1s212ms (236.001ms) - Closed: 1s300ms (88.000ms) - ConvertRowBatchTime: 24.000ms - PeakMemoryUsage: 14.33 MB (15021323) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 34.30 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.15 MB (14835712) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.15 MB (14835712) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 93.25 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 32.000ms - DataWaitTime: 12.000ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 4.79 MB, 42.69 MB - DeferredQueueSize (500.000ms): 10, 10, 0 - DispatchTime: (Avg: 22.258us ; Min: 6.062us ; Max: 359.732us ; Number of samples: 1881) - DeserializeRowBatchTime: 96.000ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 1s136ms - TotalRPCsDeferred: 1.58K (1583) HASH_JOIN_NODE (id=7):(Total: 31s836ms, non-child: 228.001ms, % non-child: 0.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s692ms - Open Started: 972.006ms (972.006ms) - Open Finished: 2s780ms (1s808ms) - First Batch Requested: 2s780ms (0.000ns) - First Batch Returned: 2s780ms (0.000ns) - Last Batch Returned: 41s692ms (38s912ms) - Closed: 41s692ms (0.000ns) - BuildRows: 365 (365) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 8.03 MB (8423680) - ProbeRows: 6.35M (6353496) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 216.001ms - RowsReturned: 6.35M (6353496) - RowsReturnedRate: 199.57 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.35M (6353861) - Resizes: 0 (0) - Travel: 2.18M (2183475) EXCHANGE_NODE (id=13): Node Lifecycle Event Timeline: 976.006ms - Open Started: 972.006ms (972.006ms) - Open Finished: 972.006ms (0.000ns) - First Batch Requested: 976.006ms (4.000ms) - First Batch Returned: 976.006ms (0.000ns) - Last Batch Returned: 976.006ms (0.000ns) - Closed: 976.006ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 14.626us ; Min: 14.626us ; Max: 14.626us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 31s608ms, non-child: 28s424ms, % non-child: 89.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s692ms - Open Started: 972.006ms (972.006ms) - Open Finished: 2s772ms (1s800ms) - First Batch Requested: 2s772ms (0.000ns) - First Batch Returned: 2s780ms (8.000ms) - Last Batch Returned: 41s692ms (38s912ms) - Closed: 41s692ms (0.000ns) - BuildRows: 9.17M (9173330) - BuildTime: 1s328ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 546.00M (546000866) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26s940ms - RowsReturned: 6.35M (6353496) - RowsReturnedRate: 201.01 K/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 876.006ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 448.003ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 542.34M (542339468) - Resizes: 0 (0) - Travel: 356.82M (356823074) EXCHANGE_NODE (id=12):(Total: 400.002ms, non-child: 124.000ms, % non-child: 31.00%) Node Lifecycle Event Timeline: 2s712ms - Open Started: 972.006ms (972.006ms) - Open Finished: 972.006ms (0.000ns) - First Batch Requested: 976.006ms (4.000ms) - First Batch Returned: 976.006ms (0.000ns) - Last Batch Returned: 2s264ms (1s288ms) - Closed: 2s712ms (448.003ms) - ConvertRowBatchTime: 108.000ms - PeakMemoryUsage: 13.15 MB (13783954) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 22.93 M/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 85.86 MB, 272.65 MB, 471.13 MB, 489.91 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 292.002ms - DataWaitTime: 276.001ms Enqueue: - BytesReceived (500.000ms): 4.53 MB, 4.53 MB, 37.40 MB, 118.77 MB, 205.24 MB, 213.42 MB - DeferredQueueSize (500.000ms): 8, 8, 0, 0, 0, 0 - DispatchTime: (Avg: 19.442us ; Min: 5.687us ; Max: 242.126us ; Number of samples: 8969) - DeserializeRowBatchTime: 472.003ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 970.868ms - TotalRPCsDeferred: 754 (754) HDFS_SCAN_NODE (id=0):(Total: 2s784ms, non-child: 2s784ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:603/138.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: All filters arrived. Waited 0. Maximum arrival delay: 2s265ms. Hdfs Read Thread Concurrency Bucket: 0:83.95% 1:14.81% 2:1.235% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:118 PARQUET/Unknown(Skipped):485 Node Lifecycle Event Timeline: 41s692ms - Open Started: 972.006ms (972.006ms) - Open Finished: 972.006ms (0.000ns) - First Batch Requested: 2s712ms (1s740ms) - First Batch Returned: 2s772ms (60.000ms) - Last Batch Returned: 41s688ms (38s916ms) - Closed: 41s692ms (4.000ms) - BytesRead (1s000ms): 0, 0, 0, 697.19 MB, 853.36 MB, 1.00 GB, 1.18 GB, 1.54 GB, 1.88 GB, 2.09 GB, 2.30 GB, 2.63 GB, 3.00 GB, 3.18 GB, 3.36 GB, 3.66 GB, 4.00 GB, 4.28 GB, 4.48 GB, 4.76 GB, 5.07 GB, 5.37 GB, 5.56 GB, 5.75 GB, 6.09 GB, 6.42 GB, 6.64 GB, 6.88 GB, 7.20 GB, 7.46 GB, 7.75 GB, 7.95 GB, 8.17 GB, 8.47 GB, 8.74 GB, 8.98 GB, 9.22 GB, 9.48 GB, 9.82 GB, 9.99 GB, 10.18 GB - FooterProcessingTime: (Avg: 101.695us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 118) - InitialRangeActualReservation: (Avg: 56.27 MB (59004615) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 118) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 118) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1215654364) ; Min: 472.47 MB (495423105) ; Max: 2.00 GB (2152479127) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.65 KB (41623) ; Min: 11.00 B (11) ; Max: 70.54 KB (72238) ; Number of samples: 262855) - ParquetRowGroupActualReservation: (Avg: 58.31 MB (61137312) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 118) - ParquetRowGroupIdealReservation: (Avg: 117.97 MB (123696423) ; Min: 88.00 MB (92274688) ; Max: 144.00 MB (150994944) ; Number of samples: 118) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1931771116) ; Min: 485.44 MB (509021497) ; Max: 3.67 GB (3936144805) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.59 KB (66142) ; Min: 9.00 B (9) ; Max: 71.56 KB (73278) ; Number of samples: 262855) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 12.21 - BytesRead: 10.32 GB (11078288239) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4.20K (4201) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.29 GB (11053122415) - DataCacheHitCount: 4.20K (4196) - DataCacheMissBytes: 24.00 MB (25165824) - DataCacheMissCount: 5 (5) - DataCachePartialHitCount: 1 (1) - DecompressionTime: 8s712ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 262.86K (262855) - NumRowGroups: 118 (118) - NumRowGroupsWithPageIndex: 118 (118) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 799.55 MB (838384695) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.54 GB (33861109760) - RowBatchQueueGetWaitTime: 108.000ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 6m56s - RowBatchesEnqueued: 533.46K (533457) - RowsRead: 546.08M (546084782) - RowsReturned: 546.00M (546000866) - RowsReturnedRate: 196.12 M/sec - ScanRangesComplete: 603 (603) - ScannerIoWaitTime: 4s612ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 814 (814) - ScannerThreadsTotalWallClockTime: 8m17s - ScannerThreadsSysTime: 16s425ms - ScannerThreadsUserTime: 1m2s - ScannerThreadsVoluntaryContextSwitches: 537.25K (537248) - TotalRawHdfsOpenFileTime(*): 24.000ms - TotalRawHdfsReadTime(*): 7s848ms - TotalReadThroughput: 253.65 MB/sec Buffer pool: - AllocTime: 500.003ms - CumulativeAllocationBytes: 6.23 GB (6685982720) - CumulativeAllocations: 1.33K (1329) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 722.00 MB (757071872) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 500.003ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2017228) - Rows rejected: 47.97K (47969) - Rows total: 546.08M (546084782) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1969259) - Rows rejected: 23.93K (23930) - Rows total: 546.04M (546036813) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1945329) - Rows rejected: 12.02K (12017) - Rows total: 546.01M (546012883) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 603 (603) - Files rejected: 485 (485) - Files total: 603 (603) - RowGroups processed: 533.22K (533221) - RowGroups rejected: 0 (0) - RowGroups total: 533.22K (533221) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 546.00M (546000866) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 546.00M (546000866) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 968.006ms, non-child: 968.006ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 13 (13) - CodegenTotalWallClockTime: 968.006ms - CodegenSysTime: 0.000ns - CodegenUserTime: 967.752ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 296.002ms - IrGenerationTime: 28.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 628.004ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 12.000ms Instance 2a45c19935b2f933:e73e98700000001b (host=impala-executor-000-2:22000):(Total: 41s460ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:12.295 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:601/139.04 GB Filter 0 arrival: 938ms Filter 2 arrival: 938ms Filter 6 arrival: 938ms Filter 4 arrival: 1s211ms Filter 8 arrival: 2s264ms Fragment Instance Lifecycle Event Timeline: 41s460ms - Prepare Finished: 4.000ms (4.000ms) - Open Finished: 41s460ms (41s456ms) - First Batch Produced: 41s460ms (0.000ns) - First Batch Sent: 41s460ms (0.000ns) - ExecInternal Finished: 41s460ms (0.000ns) - MemoryUsage (1s000ms): 38.54 MB, 388.15 MB, 1.11 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.28 GB - ThreadUsage (1s000ms): 1, 2, 8, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 8 - AverageThreadTokens: 13.01 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1786015113) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1786015113) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 388.000ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s204ms - TotalThreadsInvoluntaryContextSwitches: 881 (881) - TotalThreadsTotalWallClockTime: 8m57s - TotalThreadsSysTime: 24s460ms - TotalThreadsUserTime: 1m35s - TotalThreadsVoluntaryContextSwitches: 540.29K (540292) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 41s456ms - ExecTreeOpenTime: 40s524ms - PrepareTime: 4.000ms - ExecTreePrepareTime: 4.000ms KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 133.75 KB/sec ; Min: 133.75 KB/sec ; Max: 133.75 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 238.101us ; Min: 103.833us ; Max: 372.370us ; Number of samples: 2) - RpcRecvrTime: (Avg: 33.777us ; Min: 14.815us ; Max: 52.740us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 40s528ms, non-child: 6s296ms, % non-child: 15.53%) Node Lifecycle Event Timeline: 41s460ms - Open Started: 936.000ms (936.000ms) - Open Finished: 41s460ms (40s524ms) - First Batch Requested: 41s460ms (0.000ns) - First Batch Returned: 41s460ms (0.000ns) - Last Batch Returned: 41s460ms (0.000ns) - Closed: 41s460ms (0.000ns) - PeakMemoryUsage: 17.98 MB (18853888) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 4.000ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 34s232ms, non-child: 1s212ms, % non-child: 3.54%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s460ms - Open Started: 936.000ms (936.000ms) - Open Finished: 2s768ms (1s832ms) - First Batch Requested: 2s768ms (0.000ns) - First Batch Returned: 2s780ms (12.000ms) - Last Batch Returned: 41s456ms (38s676ms) - Closed: 41s460ms (4.000ms) - BuildRows: 7.20K (7200) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 19.93 MB (20900096) - ProbeRows: 6.30M (6298054) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s200ms - RowsReturned: 7.94K (7937) - RowsReturnedRate: 231.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.30M (6295347) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 940.000ms - Open Started: 936.000ms (936.000ms) - Open Finished: 936.000ms (0.000ns) - First Batch Requested: 936.000ms (0.000ns) - First Batch Returned: 936.000ms (0.000ns) - Last Batch Returned: 936.000ms (0.000ns) - Closed: 940.000ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 21.794us ; Min: 15.619us ; Max: 38.764us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 33s020ms, non-child: 296.000ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s460ms - Open Started: 936.000ms (936.000ms) - Open Finished: 2s768ms (1s832ms) - First Batch Requested: 2s768ms (0.000ns) - First Batch Returned: 2s768ms (0.000ns) - Last Batch Returned: 41s456ms (38s688ms) - Closed: 41s460ms (4.000ms) - BuildRows: 1.50K (1500) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 14.05 MB (14729472) - ProbeRows: 6.32M (6319395) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 284.000ms - RowsReturned: 6.30M (6298054) - RowsReturnedRate: 190.73 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.30M (6299554) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 940.000ms - Open Started: 936.000ms (936.000ms) - Open Finished: 936.000ms (0.000ns) - First Batch Requested: 936.000ms (0.000ns) - First Batch Returned: 936.000ms (0.000ns) - Last Batch Returned: 936.000ms (0.000ns) - Closed: 940.000ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 18.113us ; Min: 17.378us ; Max: 18.849us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 32s724ms, non-child: 928.000ms, % non-child: 2.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s460ms - Open Started: 936.000ms (936.000ms) - Open Finished: 2s768ms (1s832ms) - First Batch Requested: 2s768ms (0.000ns) - First Batch Returned: 2s768ms (0.000ns) - Last Batch Returned: 41s456ms (38s688ms) - Closed: 41s460ms (4.000ms) - BuildRows: 1.92M (1920800) - BuildTime: 292.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 166.77 MB (174874880) - ProbeRows: 6.36M (6358200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 916.000ms - RowsReturned: 6.32M (6319395) - RowsReturnedRate: 193.11 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 192.000ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 92.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.24M (8240195) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 76.000ms, non-child: 36.000ms, % non-child: 47.37%) Node Lifecycle Event Timeline: 1s304ms - Open Started: 936.000ms (936.000ms) - Open Finished: 936.000ms (0.000ns) - First Batch Requested: 940.000ms (4.000ms) - First Batch Returned: 940.000ms (0.000ns) - Last Batch Returned: 1s212ms (272.000ms) - Closed: 1s304ms (92.000ms) - ConvertRowBatchTime: 32.000ms - PeakMemoryUsage: 14.26 MB (14955891) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 25.27 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 94.47 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 40.000ms - DataWaitTime: 40.000ms Enqueue: - BytesReceived (500.000ms): 4.77 MB, 4.77 MB, 43.22 MB - DeferredQueueSize (500.000ms): 9, 9, 0 - DispatchTime: (Avg: 20.829us ; Min: 7.073us ; Max: 442.505us ; Number of samples: 1881) - DeserializeRowBatchTime: 84.000ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 902.521ms - TotalRPCsDeferred: 14 (14) HASH_JOIN_NODE (id=7):(Total: 31s796ms, non-child: 244.000ms, % non-child: 0.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s460ms - Open Started: 936.000ms (936.000ms) - Open Finished: 2s768ms (1s832ms) - First Batch Requested: 2s768ms (0.000ns) - First Batch Returned: 2s768ms (0.000ns) - Last Batch Returned: 41s456ms (38s688ms) - Closed: 41s460ms (4.000ms) - BuildRows: 365 (365) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 7.98 MB (8364288) - ProbeRows: 6.36M (6358200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 244.000ms - RowsReturned: 6.36M (6358200) - RowsReturnedRate: 199.97 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.36M (6358565) - Resizes: 0 (0) - Travel: 2.32M (2320452) EXCHANGE_NODE (id=13): Node Lifecycle Event Timeline: 940.000ms - Open Started: 936.000ms (936.000ms) - Open Finished: 936.000ms (0.000ns) - First Batch Requested: 940.000ms (4.000ms) - First Batch Returned: 940.000ms (0.000ns) - Last Batch Returned: 940.000ms (0.000ns) - Closed: 940.000ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 19.533us ; Min: 19.533us ; Max: 19.533us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 31s552ms, non-child: 28s244ms, % non-child: 89.52%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s460ms - Open Started: 936.000ms (936.000ms) - Open Finished: 2s760ms (1s824ms) - First Batch Requested: 2s760ms (0.000ns) - First Batch Returned: 2s768ms (8.000ms) - Last Batch Returned: 41s456ms (38s688ms) - Closed: 41s460ms (4.000ms) - BuildRows: 9.17M (9173330) - BuildTime: 1s304ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 545.70M (545697620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26s808ms - RowsReturned: 6.36M (6358200) - RowsReturnedRate: 201.51 K/sec Buffer pool: - AllocTime: 8.000ms - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 8.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 852.000ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 448.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 542.04M (542043722) - Resizes: 0 (0) - Travel: 356.35M (356352694) EXCHANGE_NODE (id=12):(Total: 460.000ms, non-child: 128.000ms, % non-child: 27.83%) Node Lifecycle Event Timeline: 2s712ms - Open Started: 936.000ms (936.000ms) - Open Finished: 936.000ms (0.000ns) - First Batch Requested: 940.000ms (4.000ms) - First Batch Returned: 940.000ms (0.000ns) - Last Batch Returned: 2s264ms (1s324ms) - Closed: 2s712ms (448.000ms) - ConvertRowBatchTime: 108.000ms - PeakMemoryUsage: 13.10 MB (13733338) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 19.94 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 100.19 MB, 288.02 MB, 484.25 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 344.000ms - DataWaitTime: 332.000ms Enqueue: - BytesReceived (500.000ms): 4.53 MB, 4.53 MB, 43.67 MB, 125.49 MB, 210.95 MB - DeferredQueueSize (500.000ms): 8, 8, 0, 0, 0 - DispatchTime: (Avg: 17.829us ; Min: 5.468us ; Max: 333.754us ; Number of samples: 8969) - DeserializeRowBatchTime: 368.000ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 823.957ms - TotalRPCsDeferred: 8 (8) HDFS_SCAN_NODE (id=0):(Total: 2s848ms, non-child: 2s848ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:601/139.04 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 113 out of 113 Runtime filters: All filters arrived. Waited 0. Maximum arrival delay: 2s264ms. Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:4.938% 2:3.704% 3:1.235% 4:0% 5:0% 6:0% 7:0% 8:1.235% File Formats: PARQUET/SNAPPY:113 PARQUET/Unknown(Skipped):488 Node Lifecycle Event Timeline: 41s460ms - Open Started: 936.000ms (936.000ms) - Open Finished: 936.000ms (0.000ns) - First Batch Requested: 2s712ms (1s776ms) - First Batch Returned: 2s760ms (48.000ms) - Last Batch Returned: 41s452ms (38s692ms) - Closed: 41s460ms (8.000ms) - BytesRead (1s000ms): 0, 0, 255.94 MB, 665.07 MB, 856.96 MB, 1.04 GB, 1.17 GB, 1.59 GB, 1.92 GB, 2.12 GB, 2.32 GB, 2.55 GB, 3.09 GB, 3.19 GB, 3.50 GB, 3.68 GB, 4.00 GB, 4.36 GB, 4.51 GB, 4.83 GB, 5.00 GB, 5.41 GB, 5.63 GB, 5.88 GB, 6.15 GB, 6.35 GB, 6.77 GB, 6.92 GB, 7.24 GB, 7.45 GB, 7.79 GB, 8.06 GB, 8.30 GB, 8.55 GB, 8.75 GB, 9.14 GB, 9.34 GB, 9.57 GB, 9.82 GB, 10.01 GB, 10.20 GB - FooterProcessingTime: (Avg: 389.380us ; Min: 0.000ns ; Max: 8.000ms ; Number of samples: 113) - InitialRangeActualReservation: (Avg: 55.65 MB (58349078) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 113) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 113) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1215978366) ; Min: 472.21 MB (495146383) ; Max: 2.00 GB (2151786072) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.61 KB (41587) ; Min: 11.00 B (11) ; Max: 67.90 KB (69532) ; Number of samples: 263151) - ParquetRowGroupActualReservation: (Avg: 57.77 MB (60576142) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 113) - ParquetRowGroupIdealReservation: (Avg: 122.65 MB (128612950) ; Min: 88.00 MB (92274688) ; Max: 144.00 MB (150994944) ; Number of samples: 113) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1934164469) ; Min: 485.17 MB (508735505) ; Max: 3.68 GB (3947832422) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.60 KB (66150) ; Min: 9.00 B (9) ; Max: 69.69 KB (71362) ; Number of samples: 263151) - AverageHdfsReadThreadConcurrency: 0.36 - AverageScannerThreadConcurrency: 12.26 - BytesRead: 10.32 GB (11075658052) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4.17K (4171) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.28 GB (11034151143) - DataCacheHitCount: 4.17K (4165) - DataCacheMissBytes: 39.58 MB (41506909) - DataCacheMissCount: 7 (7) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8s252ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 263.15K (263151) - NumRowGroups: 113 (113) - NumRowGroupsWithPageIndex: 113 (113) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 800.72 MB (839611783) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.52 GB (33842106368) - RowBatchQueueGetWaitTime: 100.000ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 6m55s - RowBatchesEnqueued: 533.15K (533153) - RowsRead: 545.78M (545777149) - RowsReturned: 545.70M (545697620) - RowsReturnedRate: 191.61 M/sec - ScanRangesComplete: 601 (601) - ScannerIoWaitTime: 2s204ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 802 (802) - ScannerThreadsTotalWallClockTime: 8m13s - ScannerThreadsSysTime: 16s398ms - ScannerThreadsUserTime: 1m1s - ScannerThreadsVoluntaryContextSwitches: 536.20K (536199) - TotalRawHdfsOpenFileTime(*): 76.000ms - TotalRawHdfsReadTime(*): 8s988ms - TotalReadThroughput: 254.25 MB/sec Buffer pool: - AllocTime: 420.000ms - CumulativeAllocationBytes: 5.97 GB (6413549568) - CumulativeAllocations: 1.27K (1266) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 716.06 MB (750845952) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 420.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1930921) - Rows rejected: 45.36K (45357) - Rows total: 545.78M (545777149) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.89M (1885564) - Rows rejected: 22.82K (22822) - Rows total: 545.73M (545731792) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.86M (1862742) - Rows rejected: 11.35K (11350) - Rows total: 545.71M (545708970) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 601 (601) - Files rejected: 488 (488) - Files total: 601 (601) - RowGroups processed: 532.93K (532927) - RowGroups rejected: 0 (0) - RowGroups total: 532.93K (532927) - Rows processed: 1.85M (1851392) - Rows rejected: 0 (0) - Rows total: 545.70M (545697620) - Splits processed: 113 (113) - Splits rejected: 0 (0) - Splits total: 113 (113) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.85M (1851392) - Rows rejected: 0 (0) - Rows total: 545.70M (545697620) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 932.000ms, non-child: 932.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 932.000ms - CodegenSysTime: 11.959ms - CodegenUserTime: 919.979ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 284.000ms - IrGenerationTime: 32.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 604.000ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 12.000ms Instance 2a45c19935b2f933:e73e98700000001d (host=impala-executor-000-0:22000):(Total: 41s427ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:12.265 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:604/139.01 GB Filter 0 arrival: 946ms Filter 2 arrival: 946ms Filter 6 arrival: 946ms Filter 4 arrival: 1s212ms Filter 8 arrival: 2s279ms Fragment Instance Lifecycle Event Timeline: 41s427ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 41s423ms (41s423ms) - First Batch Produced: 41s423ms (0.000ns) - First Batch Sent: 41s423ms (0.000ns) - ExecInternal Finished: 41s427ms (3.999ms) - MemoryUsage (1s000ms): 38.56 MB, 433.12 MB, 1.18 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.63 GB, 1.55 GB, 1.45 GB - ThreadUsage (1s000ms): 1, 2, 8, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 11, 9 - AverageThreadTokens: 12.93 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1785361045) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785361045) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 275.999ms - TotalNetworkSendTime: 3.999ms - TotalStorageWaitTime: 3s527ms - TotalThreadsInvoluntaryContextSwitches: 818 (818) - TotalThreadsTotalWallClockTime: 8m56s - TotalThreadsSysTime: 24s784ms - TotalThreadsUserTime: 1m35s - TotalThreadsVoluntaryContextSwitches: 541.14K (541144) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 3.999ms - ExecTreeExecTime: 0.000ns - OpenTime: 41s423ms - ExecTreeOpenTime: 40s483ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17):(Total: 3.999ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 123.44 KB/sec ; Min: 123.44 KB/sec ; Max: 123.44 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 243.786us ; Min: 84.113us ; Max: 403.460us ; Number of samples: 2) - RpcRecvrTime: (Avg: 47.764us ; Min: 16.315us ; Max: 79.213us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 40s483ms, non-child: 6s595ms, % non-child: 16.29%) Node Lifecycle Event Timeline: 41s427ms - Open Started: 939.997ms (939.997ms) - Open Finished: 41s423ms (40s483ms) - First Batch Requested: 41s423ms (0.000ns) - First Batch Returned: 41s423ms (0.000ns) - Last Batch Returned: 41s423ms (0.000ns) - Closed: 41s427ms (3.999ms) - PeakMemoryUsage: 16.77 MB (17588224) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 3.999ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 33s887ms, non-child: 1s223ms, % non-child: 3.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s423ms - Open Started: 939.997ms (939.997ms) - Open Finished: 2s795ms (1s855ms) - First Batch Requested: 2s795ms (0.000ns) - First Batch Returned: 2s807ms (11.999ms) - Last Batch Returned: 41s423ms (38s615ms) - Closed: 41s423ms (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 13.46 MB (14110976) - ProbeRows: 6.29M (6285167) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s187ms - RowsReturned: 8.51K (8510) - RowsReturnedRate: 251.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.28M (6283036) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16):(Total: 3.999ms, non-child: 3.999ms, % non-child: 100.00%) Node Lifecycle Event Timeline: 943.997ms - Open Started: 939.997ms (939.997ms) - Open Finished: 939.997ms (0.000ns) - First Batch Requested: 939.997ms (0.000ns) - First Batch Returned: 939.997ms (0.000ns) - Last Batch Returned: 943.997ms (3.999ms) - Closed: 943.997ms (0.000ns) - ConvertRowBatchTime: 3.999ms - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 1.80 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 32.424us ; Min: 16.516us ; Max: 60.433us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 32s663ms, non-child: 323.999ms, % non-child: 0.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s423ms - Open Started: 939.997ms (939.997ms) - Open Finished: 2s791ms (1s851ms) - First Batch Requested: 2s791ms (0.000ns) - First Batch Returned: 2s795ms (3.999ms) - Last Batch Returned: 41s423ms (38s627ms) - Closed: 41s423ms (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 13.45 MB (14098688) - ProbeRows: 6.30M (6304166) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 319.999ms - RowsReturned: 6.29M (6285167) - RowsReturnedRate: 192.42 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.29M (6286667) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 943.997ms - Open Started: 939.997ms (939.997ms) - Open Finished: 939.997ms (0.000ns) - First Batch Requested: 943.997ms (3.999ms) - First Batch Returned: 943.997ms (0.000ns) - Last Batch Returned: 943.997ms (0.000ns) - Closed: 943.997ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 28.433us ; Min: 17.388us ; Max: 39.478us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 32s339ms, non-child: 843.997ms, % non-child: 2.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s423ms - Open Started: 939.997ms (939.997ms) - Open Finished: 2s783ms (1s843ms) - First Batch Requested: 2s783ms (0.000ns) - First Batch Returned: 2s791ms (7.999ms) - Last Batch Returned: 41s423ms (38s631ms) - Closed: 41s423ms (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 303.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 165.99 MB (174049536) - ProbeRows: 6.34M (6342663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 835.997ms - RowsReturned: 6.30M (6304166) - RowsReturnedRate: 194.93 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 215.999ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 83.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.22M (8224966) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 51.999ms, non-child: 27.999ms, % non-child: 53.85%) Node Lifecycle Event Timeline: 1s295ms - Open Started: 939.997ms (939.997ms) - Open Finished: 939.997ms (0.000ns) - First Batch Requested: 943.997ms (3.999ms) - First Batch Returned: 943.997ms (0.000ns) - Last Batch Returned: 1s211ms (267.999ms) - Closed: 1s295ms (83.999ms) - ConvertRowBatchTime: 15.999ms - PeakMemoryUsage: 14.29 MB (14979902) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 36.94 M/sec Buffer pool: - AllocTime: 3.999ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 23.999ms - DataWaitTime: 23.999ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 4.79 MB - DeferredQueueSize (500.000ms): 10, 10 - DispatchTime: (Avg: 20.407us ; Min: 9.643us ; Max: 216.031us ; Number of samples: 1881) - DeserializeRowBatchTime: 131.999ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 909.379ms - TotalRPCsDeferred: 13 (13) HASH_JOIN_NODE (id=7):(Total: 31s495ms, non-child: 223.999ms, % non-child: 0.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s423ms - Open Started: 939.997ms (939.997ms) - Open Finished: 2s783ms (1s843ms) - First Batch Requested: 2s783ms (0.000ns) - First Batch Returned: 2s783ms (0.000ns) - Last Batch Returned: 41s423ms (38s639ms) - Closed: 41s423ms (0.000ns) - BuildRows: 365 (365) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 7.92 MB (8300800) - ProbeRows: 6.34M (6342663) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 199.999ms - RowsReturned: 6.34M (6342663) - RowsReturnedRate: 201.38 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.34M (6343028) - Resizes: 0 (0) - Travel: 2.08M (2080679) EXCHANGE_NODE (id=13): Node Lifecycle Event Timeline: 943.997ms - Open Started: 939.997ms (939.997ms) - Open Finished: 939.997ms (0.000ns) - First Batch Requested: 943.997ms (3.999ms) - First Batch Returned: 943.997ms (0.000ns) - Last Batch Returned: 943.997ms (0.000ns) - Closed: 943.997ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 22.214us ; Min: 22.214us ; Max: 22.214us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 31s271ms, non-child: 27s819ms, % non-child: 88.96%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 41s423ms - Open Started: 939.997ms (939.997ms) - Open Finished: 2s779ms (1s839ms) - First Batch Requested: 2s779ms (0.000ns) - First Batch Returned: 2s783ms (3.999ms) - Last Batch Returned: 41s423ms (38s639ms) - Closed: 41s423ms (0.000ns) - BuildRows: 9.17M (9173330) - BuildTime: 1s391ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 547.23M (547227837) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26s275ms - RowsReturned: 6.34M (6342663) - RowsReturnedRate: 202.82 K/sec Buffer pool: - AllocTime: 7.999ms - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 7.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 939.997ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 447.998ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 543.54M (543536632) - Resizes: 0 (0) - Travel: 358.17M (358171664) EXCHANGE_NODE (id=12):(Total: 375.999ms, non-child: 143.999ms, % non-child: 38.30%) Node Lifecycle Event Timeline: 2s723ms - Open Started: 939.997ms (939.997ms) - Open Finished: 939.997ms (0.000ns) - First Batch Requested: 943.997ms (3.999ms) - First Batch Returned: 943.997ms (0.000ns) - Last Batch Returned: 2s275ms (1s331ms) - Closed: 2s723ms (447.998ms) - ConvertRowBatchTime: 123.999ms - PeakMemoryUsage: 13.12 MB (13758431) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 24.40 M/sec Buffer pool: - AllocTime: 7.999ms - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 13.00 MB (13631488) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 13.00 MB (13631488) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 142.73 MB, 330.46 MB, 489.91 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 243.999ms - DataWaitTime: 231.999ms Enqueue: - BytesReceived (500.000ms): 4.53 MB, 4.53 MB, 62.25 MB, 143.96 MB, 213.42 MB - DeferredQueueSize (500.000ms): 8, 8, 0, 0, 0 - DispatchTime: (Avg: 18.695us ; Min: 5.901us ; Max: 275.827us ; Number of samples: 8969) - DeserializeRowBatchTime: 455.998ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 891.760ms - TotalRPCsDeferred: 390 (390) HDFS_SCAN_NODE (id=0):(Total: 3s075ms, non-child: 3s075ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:604/139.01 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: All filters arrived. Waited 0. Maximum arrival delay: 2s279ms. Hdfs Read Thread Concurrency Bucket: 0:90.12% 1:6.173% 2:2.469% 3:1.235% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:116 PARQUET/Unknown(Skipped):488 Node Lifecycle Event Timeline: 41s423ms - Open Started: 939.997ms (939.997ms) - Open Finished: 939.997ms (0.000ns) - First Batch Requested: 2s723ms (1s783ms) - First Batch Returned: 2s779ms (55.999ms) - Last Batch Returned: 41s419ms (38s639ms) - Closed: 41s423ms (3.999ms) - BytesRead (1s000ms): 0, 0, 337.44 MB, 697.38 MB, 874.38 MB, 1.05 GB, 1.22 GB, 1.80 GB, 1.93 GB, 2.17 GB, 2.33 GB, 2.68 GB, 3.02 GB, 3.14 GB, 3.43 GB, 3.75 GB, 4.10 GB, 4.30 GB, 4.50 GB, 4.74 GB, 5.16 GB, 5.43 GB, 5.57 GB, 5.85 GB, 6.19 GB, 6.49 GB, 6.71 GB, 6.89 GB, 7.24 GB, 7.62 GB, 7.78 GB, 8.03 GB, 8.20 GB, 8.57 GB, 8.89 GB, 9.15 GB, 9.32 GB, 9.55 GB, 9.94 GB, 10.11 GB, 10.27 GB - FooterProcessingTime: (Avg: 275.861us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 116) - InitialRangeActualReservation: (Avg: 56.52 MB (59262622) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 116) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 116) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.14 GB (1219470307) ; Min: 473.53 MB (496532174) ; Max: 2.01 GB (2157670419) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.64 KB (41616) ; Min: 11.00 B (11) ; Max: 70.22 KB (71903) ; Number of samples: 263722) - ParquetRowGroupActualReservation: (Avg: 58.59 MB (61432090) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 116) - ParquetRowGroupIdealReservation: (Avg: 120.04 MB (125875729) ; Min: 1.16 MB (1212416) ; Max: 144.00 MB (150994944) ; Number of samples: 116) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.81 GB (1938214151) ; Min: 486.52 MB (510151358) ; Max: 3.68 GB (3953575849) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.59 KB (66145) ; Min: 9.00 B (9) ; Max: 71.01 KB (72715) ; Number of samples: 263722) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 12.19 - BytesRead: 10.35 GB (11109835427) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4.18K (4181) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.33 GB (11088218123) - DataCacheHitCount: 4.18K (4177) - DataCacheMissBytes: 20.62 MB (21617304) - DataCacheMissCount: 4 (4) - DataCachePartialHitCount: 1 (1) - DecompressionTime: 8s407ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 263.72K (263722) - NumRowGroups: 116 (116) - NumRowGroupsWithPageIndex: 116 (116) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 799.85 MB (838701138) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.61 GB (33937414144) - RowBatchQueueGetWaitTime: 59.999ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 6m53s - RowBatchesEnqueued: 534.66K (534657) - RowsRead: 547.31M (547309511) - RowsReturned: 547.23M (547227837) - RowsReturnedRate: 177.90 M/sec - ScanRangesComplete: 604 (604) - ScannerIoWaitTime: 3s527ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 725 (725) - ScannerThreadsTotalWallClockTime: 8m12s - ScannerThreadsSysTime: 16s171ms - ScannerThreadsUserTime: 1m3s - ScannerThreadsVoluntaryContextSwitches: 538.39K (538392) - TotalRawHdfsOpenFileTime(*): 19.999ms - TotalRawHdfsReadTime(*): 7s399ms - TotalReadThroughput: 255.30 MB/sec Buffer pool: - AllocTime: 495.998ms - CumulativeAllocationBytes: 6.17 GB (6619758592) - CumulativeAllocations: 1.32K (1319) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 716.00 MB (750780416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 495.998ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1982218) - Rows rejected: 46.40K (46402) - Rows total: 547.31M (547309511) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935816) - Rows rejected: 23.43K (23430) - Rows total: 547.26M (547263109) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.91M (1912386) - Rows rejected: 11.84K (11842) - Rows total: 547.24M (547239679) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 604 (604) - Files rejected: 488 (488) - Files total: 604 (604) - RowGroups processed: 534.42K (534425) - RowGroups rejected: 0 (0) - RowGroups total: 534.42K (534425) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 547.23M (547227837) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 547.23M (547227837) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 939.997ms, non-child: 939.997ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 939.997ms - CodegenSysTime: 3.998ms - CodegenUserTime: 935.700ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 283.999ms - IrGenerationTime: 31.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 611.998ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 11.999ms Instance 2a45c19935b2f933:e73e987000000018 (host=impala-executor-000-7:22000):(Total: 40s967ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:11.805 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/139.10 GB Filter 0 arrival: 921ms Filter 2 arrival: 921ms Filter 6 arrival: 921ms Filter 4 arrival: 1s213ms Filter 8 arrival: 2s266ms Fragment Instance Lifecycle Event Timeline: 40s967ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 40s967ms (40s967ms) - First Batch Produced: 40s967ms (0.000ns) - First Batch Sent: 40s967ms (0.000ns) - ExecInternal Finished: 40s967ms (0.000ns) - MemoryUsage (1s000ms): 36.96 MB, 328.15 MB, 737.12 MB, 1.64 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.38 GB, 1.05 GB - ThreadUsage (1s000ms): 1, 2, 2, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 9, 4 - AverageThreadTokens: 12.77 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1784907923) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1784907923) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 399.998ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 3s167ms - TotalThreadsInvoluntaryContextSwitches: 936 (936) - TotalThreadsTotalWallClockTime: 8m45s - TotalThreadsSysTime: 23s955ms - TotalThreadsUserTime: 1m34s - TotalThreadsVoluntaryContextSwitches: 540.46K (540455) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 40s967ms - ExecTreeOpenTime: 40s051ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 175.40 KB/sec ; Min: 175.40 KB/sec ; Max: 175.40 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 211.099us ; Min: 138.243us ; Max: 283.956us ; Number of samples: 2) - RpcRecvrTime: (Avg: 23.170us ; Min: 14.911us ; Max: 31.430us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 40s051ms, non-child: 6s287ms, % non-child: 15.70%) Node Lifecycle Event Timeline: 40s967ms - Open Started: 915.997ms (915.997ms) - Open Finished: 40s967ms (40s051ms) - First Batch Requested: 40s967ms (0.000ns) - First Batch Returned: 40s967ms (0.000ns) - Last Batch Returned: 40s967ms (0.000ns) - Closed: 40s967ms (0.000ns) - PeakMemoryUsage: 16.52 MB (17326080) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 3.999ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 33s763ms, non-child: 1s323ms, % non-child: 3.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s967ms - Open Started: 915.997ms (915.997ms) - Open Finished: 2s763ms (1s847ms) - First Batch Requested: 2s763ms (0.000ns) - First Batch Returned: 2s771ms (7.999ms) - Last Batch Returned: 40s967ms (38s195ms) - Closed: 40s967ms (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 17.33 MB (18170112) - ProbeRows: 6.27M (6266915) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s303ms - RowsReturned: 9.08K (9076) - RowsReturnedRate: 268.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.26M (6264378) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 919.997ms - Open Started: 915.997ms (915.997ms) - Open Finished: 915.997ms (0.000ns) - First Batch Requested: 915.997ms (0.000ns) - First Batch Returned: 915.997ms (0.000ns) - Last Batch Returned: 915.997ms (0.000ns) - Closed: 919.997ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 21.352us ; Min: 14.917us ; Max: 32.725us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 32s439ms, non-child: 203.999ms, % non-child: 0.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s967ms - Open Started: 915.997ms (915.997ms) - Open Finished: 2s763ms (1s847ms) - First Batch Requested: 2s763ms (0.000ns) - First Batch Returned: 2s763ms (0.000ns) - Last Batch Returned: 40s967ms (38s203ms) - Closed: 40s967ms (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 17.32 MB (18157824) - ProbeRows: 6.29M (6286080) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 187.999ms - RowsReturned: 6.27M (6266915) - RowsReturnedRate: 193.19 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.27M (6268415) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 919.997ms - Open Started: 915.997ms (915.997ms) - Open Finished: 915.997ms (0.000ns) - First Batch Requested: 915.997ms (0.000ns) - First Batch Returned: 915.997ms (0.000ns) - Last Batch Returned: 915.997ms (0.000ns) - Closed: 919.997ms (3.999ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 3.999ms - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 22.779us ; Min: 14.450us ; Max: 31.108us ; Number of samples: 2) - DeserializeRowBatchTime: 3.999ms - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 32s235ms, non-child: 859.996ms, % non-child: 2.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s967ms - Open Started: 915.997ms (915.997ms) - Open Finished: 2s763ms (1s847ms) - First Batch Requested: 2s763ms (0.000ns) - First Batch Returned: 2s763ms (0.000ns) - Last Batch Returned: 40s967ms (38s203ms) - Closed: 40s967ms (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 279.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 170.35 MB (178620672) - ProbeRows: 6.33M (6325157) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 851.996ms - RowsReturned: 6.29M (6286080) - RowsReturnedRate: 195.00 K/sec Buffer pool: - AllocTime: 3.999ms - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 187.999ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 91.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.21M (8206880) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 107.999ms, non-child: 19.999ms, % non-child: 18.52%) Node Lifecycle Event Timeline: 1s303ms - Open Started: 915.997ms (915.997ms) - Open Finished: 915.997ms (0.000ns) - First Batch Requested: 915.997ms (0.000ns) - First Batch Returned: 915.997ms (0.000ns) - Last Batch Returned: 1s211ms (295.999ms) - Closed: 1s303ms (91.999ms) - ConvertRowBatchTime: 19.999ms - PeakMemoryUsage: 14.26 MB (14955635) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 17.79 M/sec Buffer pool: - AllocTime: 11.999ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 53.26 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 87.999ms - DataWaitTime: 87.999ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 4.79 MB, 24.53 MB - DeferredQueueSize (500.000ms): 10, 10, 0 - DispatchTime: (Avg: 22.641us ; Min: 5.768us ; Max: 1.717ms ; Number of samples: 1881) - DeserializeRowBatchTime: 139.999ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 881.596ms - TotalRPCsDeferred: 10 (10) HASH_JOIN_NODE (id=7):(Total: 31s375ms, non-child: 251.998ms, % non-child: 0.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s967ms - Open Started: 915.997ms (915.997ms) - Open Finished: 2s763ms (1s847ms) - First Batch Requested: 2s763ms (0.000ns) - First Batch Returned: 2s763ms (0.000ns) - Last Batch Returned: 40s967ms (38s203ms) - Closed: 40s967ms (0.000ns) - BuildRows: 365 (365) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 8.03 MB (8423680) - ProbeRows: 6.33M (6325157) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 235.998ms - RowsReturned: 6.33M (6325157) - RowsReturnedRate: 201.59 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.33M (6325522) - Resizes: 0 (0) - Travel: 2.06M (2063860) EXCHANGE_NODE (id=13): Node Lifecycle Event Timeline: 919.997ms - Open Started: 915.997ms (915.997ms) - Open Finished: 915.997ms (0.000ns) - First Batch Requested: 919.997ms (3.999ms) - First Batch Returned: 919.997ms (0.000ns) - Last Batch Returned: 919.997ms (0.000ns) - Closed: 919.997ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 15.282us ; Min: 15.282us ; Max: 15.282us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 31s123ms, non-child: 27s583ms, % non-child: 88.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s967ms - Open Started: 915.997ms (915.997ms) - Open Finished: 2s755ms (1s839ms) - First Batch Requested: 2s755ms (0.000ns) - First Batch Returned: 2s763ms (7.999ms) - Last Batch Returned: 40s967ms (38s203ms) - Closed: 40s967ms (0.000ns) - BuildRows: 9.17M (9173330) - BuildTime: 1s379ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 545.24M (545242452) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26s015ms - RowsReturned: 6.33M (6325157) - RowsReturnedRate: 203.22 K/sec Buffer pool: - AllocTime: 3.999ms - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 939.994ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 435.996ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 541.61M (541608862) - Resizes: 0 (0) - Travel: 356.66M (356657006) EXCHANGE_NODE (id=12):(Total: 395.997ms, non-child: 95.999ms, % non-child: 24.24%) Node Lifecycle Event Timeline: 2s699ms - Open Started: 915.997ms (915.997ms) - Open Finished: 915.997ms (0.000ns) - First Batch Requested: 919.997ms (3.999ms) - First Batch Returned: 919.997ms (0.000ns) - Last Batch Returned: 2s263ms (1s343ms) - Closed: 2s699ms (435.996ms) - ConvertRowBatchTime: 83.999ms - PeakMemoryUsage: 13.10 MB (13733278) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 23.17 M/sec Buffer pool: - AllocTime: 7.999ms - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 50.53 MB, 231.80 MB, 426.18 MB, 489.91 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 311.998ms - DataWaitTime: 299.998ms Enqueue: - BytesReceived (500.000ms): 0, 4.53 MB, 22.06 MB, 100.98 MB, 185.68 MB, 213.42 MB - DeferredQueueSize (500.000ms): 0, 8, 0, 0, 0, 0 - DispatchTime: (Avg: 19.110us ; Min: 6.468us ; Max: 1.681ms ; Number of samples: 8969) - DeserializeRowBatchTime: 419.997ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 804.274ms - TotalRPCsDeferred: 10 (10) HDFS_SCAN_NODE (id=0):(Total: 3s143ms, non-child: 3s143ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/139.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: All filters arrived. Waited 0. Maximum arrival delay: 2s266ms. Hdfs Read Thread Concurrency Bucket: 0:91.25% 1:7.5% 2:1.25% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:116 PARQUET/Unknown(Skipped):482 Node Lifecycle Event Timeline: 40s967ms - Open Started: 915.997ms (915.997ms) - Open Finished: 915.997ms (0.000ns) - First Batch Requested: 2s699ms (1s783ms) - First Batch Returned: 2s755ms (55.999ms) - Last Batch Returned: 40s959ms (38s203ms) - Closed: 40s967ms (7.999ms) - BytesRead (1s000ms): 0, 0, 0, 689.09 MB, 801.77 MB, 1.01 GB, 1.26 GB, 1.66 GB, 1.92 GB, 2.09 GB, 2.35 GB, 2.67 GB, 3.05 GB, 3.15 GB, 3.56 GB, 3.72 GB, 4.04 GB, 4.29 GB, 4.59 GB, 4.87 GB, 5.05 GB, 5.39 GB, 5.62 GB, 6.01 GB, 6.20 GB, 6.46 GB, 6.75 GB, 7.04 GB, 7.30 GB, 7.52 GB, 7.84 GB, 8.18 GB, 8.40 GB, 8.66 GB, 8.88 GB, 9.27 GB, 9.48 GB, 9.69 GB, 9.95 GB, 10.13 GB, 10.29 GB - FooterProcessingTime: (Avg: 137.930us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 116) - InitialRangeActualReservation: (Avg: 56.52 MB (59262622) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 116) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 116) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.13 GB (1215767100) ; Min: 471.81 MB (494725088) ; Max: 2.00 GB (2149880961) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.67 KB (41641) ; Min: 11.00 B (11) ; Max: 69.81 KB (71488) ; Number of samples: 262767) - ParquetRowGroupActualReservation: (Avg: 58.59 MB (61432090) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 116) - ParquetRowGroupIdealReservation: (Avg: 119.23 MB (125018394) ; Min: 2.31 MB (2424832) ; Max: 144.00 MB (150994944) ; Number of samples: 116) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.80 GB (1931631788) ; Min: 484.75 MB (508297969) ; Max: 3.67 GB (3940258909) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.61 KB (66160) ; Min: 9.00 B (9) ; Max: 70.85 KB (72553) ; Number of samples: 262767) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 12.00 - BytesRead: 10.32 GB (11076674890) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 3.95K (3946) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.31 GB (11067891292) - DataCacheHitCount: 3.94K (3941) - DataCacheMissBytes: 8.38 MB (8783598) - DataCacheMissCount: 6 (6) - DataCachePartialHitCount: 1 (1) - DecompressionTime: 8s447ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 262.77K (262767) - NumRowGroups: 116 (116) - NumRowGroupsWithPageIndex: 116 (116) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 799.39 MB (838223748) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 1.87 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.49 GB (33814374400) - RowBatchQueueGetWaitTime: 407.998ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 6m43s - RowBatchesEnqueued: 532.72K (532719) - RowsRead: 545.32M (545323618) - RowsReturned: 545.24M (545242452) - RowsReturnedRate: 173.42 M/sec - ScanRangesComplete: 598 (598) - ScannerIoWaitTime: 3s167ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 831 (831) - ScannerThreadsTotalWallClockTime: 8m2s - ScannerThreadsSysTime: 15s825ms - ScannerThreadsUserTime: 1m2s - ScannerThreadsVoluntaryContextSwitches: 535.80K (535800) - TotalRawHdfsOpenFileTime(*): 59.999ms - TotalRawHdfsReadTime(*): 5s515ms - TotalReadThroughput: 257.58 MB/sec Buffer pool: - AllocTime: 575.996ms - CumulativeAllocationBytes: 6.38 GB (6845300736) - CumulativeAllocations: 1.28K (1282) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 742.00 MB (778043392) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 575.996ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1981710) - Rows rejected: 46.19K (46186) - Rows total: 545.32M (545323618) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935524) - Rows rejected: 23.49K (23492) - Rows total: 545.28M (545277432) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.91M (1912032) - Rows rejected: 11.49K (11488) - Rows total: 545.25M (545253940) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 598 (598) - Files rejected: 482 (482) - Files total: 598 (598) - RowGroups processed: 532.49K (532487) - RowGroups rejected: 0 (0) - RowGroups total: 532.49K (532487) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 545.24M (545242452) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 545.24M (545242452) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 915.997ms, non-child: 915.997ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 3 (3) - CodegenTotalWallClockTime: 915.997ms - CodegenSysTime: 0.000ns - CodegenUserTime: 915.873ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 279.999ms - IrGenerationTime: 27.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 591.998ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 11.999ms Instance 2a45c19935b2f933:e73e98700000001c (host=impala-executor-000-5:22000):(Total: 40s964ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:11.802 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/139.18 GB Filter 0 arrival: 935ms Filter 2 arrival: 935ms Filter 6 arrival: 935ms Filter 4 arrival: 1s212ms Filter 8 arrival: 2s264ms Fragment Instance Lifecycle Event Timeline: 40s964ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 40s964ms (40s964ms) - First Batch Produced: 40s964ms (0.000ns) - First Batch Sent: 40s964ms (0.000ns) - ExecInternal Finished: 40s964ms (0.000ns) - MemoryUsage (1s000ms): 38.54 MB, 376.15 MB, 785.12 MB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.43 GB, 1.22 GB - ThreadUsage (1s000ms): 1, 2, 2, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 11, 8 - AverageThreadTokens: 12.90 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1784826348) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1784826348) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 432.004ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 10s264ms - TotalThreadsInvoluntaryContextSwitches: 855 (855) - TotalThreadsTotalWallClockTime: 8m51s - TotalThreadsSysTime: 24s582ms - TotalThreadsUserTime: 1m35s - TotalThreadsVoluntaryContextSwitches: 544.46K (544461) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 40s964ms - ExecTreeOpenTime: 40s032ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 147.63 KB/sec ; Min: 147.63 KB/sec ; Max: 147.63 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 221.029us ; Min: 111.309us ; Max: 330.749us ; Number of samples: 2) - RpcRecvrTime: (Avg: 43.497us ; Min: 18.023us ; Max: 68.971us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 50.00 B (50) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 40s032ms, non-child: 6s360ms, % non-child: 15.89%) Node Lifecycle Event Timeline: 40s964ms - Open Started: 932.009ms (932.009ms) - Open Finished: 40s964ms (40s032ms) - First Batch Requested: 40s964ms (0.000ns) - First Batch Returned: 40s964ms (0.000ns) - Last Batch Returned: 40s964ms (0.000ns) - Closed: 40s964ms (0.000ns) - PeakMemoryUsage: 16.95 MB (17770496) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 33s672ms, non-child: 1s312ms, % non-child: 3.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s964ms - Open Started: 932.009ms (932.009ms) - Open Finished: 2s760ms (1s828ms) - First Batch Requested: 2s760ms (0.000ns) - First Batch Returned: 2s772ms (12.000ms) - Last Batch Returned: 40s964ms (38s192ms) - Closed: 40s964ms (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 14.97 MB (15694080) - ProbeRows: 6.34M (6343241) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s296ms - RowsReturned: 8.53K (8525) - RowsReturnedRate: 253.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.34M (6339860) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 932.009ms - Open Started: 932.009ms (932.009ms) - Open Finished: 932.009ms (0.000ns) - First Batch Requested: 932.009ms (0.000ns) - First Batch Returned: 932.009ms (0.000ns) - Last Batch Returned: 932.009ms (0.000ns) - Closed: 932.009ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 28.239us ; Min: 15.572us ; Max: 55.395us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 32s360ms, non-child: 204.001ms, % non-child: 0.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s964ms - Open Started: 932.009ms (932.009ms) - Open Finished: 2s760ms (1s828ms) - First Batch Requested: 2s760ms (0.000ns) - First Batch Returned: 2s760ms (0.000ns) - Last Batch Returned: 40s964ms (38s204ms) - Closed: 40s964ms (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 14.96 MB (15681792) - ProbeRows: 6.36M (6361712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 192.001ms - RowsReturned: 6.34M (6343241) - RowsReturnedRate: 196.02 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.34M (6344741) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 932.009ms - Open Started: 932.009ms (932.009ms) - Open Finished: 932.009ms (0.000ns) - First Batch Requested: 932.009ms (0.000ns) - First Batch Returned: 932.009ms (0.000ns) - Last Batch Returned: 932.009ms (0.000ns) - Closed: 932.009ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 25.277us ; Min: 20.902us ; Max: 29.652us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 32s156ms, non-child: 912.005ms, % non-child: 2.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s964ms - Open Started: 932.009ms (932.009ms) - Open Finished: 2s760ms (1s828ms) - First Batch Requested: 2s760ms (0.000ns) - First Batch Returned: 2s760ms (0.000ns) - Last Batch Returned: 40s964ms (38s204ms) - Closed: 40s964ms (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 292.002ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 168.11 MB (176271616) - ProbeRows: 6.40M (6400586) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 892.005ms - RowsReturned: 6.36M (6361712) - RowsReturnedRate: 197.84 K/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 196.002ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 96.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.28M (8282512) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 76.000ms, non-child: 16.000ms, % non-child: 21.05%) Node Lifecycle Event Timeline: 1s308ms - Open Started: 932.009ms (932.009ms) - Open Finished: 932.009ms (0.000ns) - First Batch Requested: 932.009ms (0.000ns) - First Batch Returned: 932.009ms (0.000ns) - Last Batch Returned: 1s212ms (280.002ms) - Closed: 1s308ms (96.000ms) - ConvertRowBatchTime: 16.000ms - PeakMemoryUsage: 14.26 MB (14955652) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 25.27 M/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 93.25 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 60.000ms - DataWaitTime: 60.000ms Enqueue: - BytesReceived (500.000ms): 4.77 MB, 4.77 MB, 42.66 MB - DeferredQueueSize (500.000ms): 9, 9, 0 - DispatchTime: (Avg: 20.839us ; Min: 7.175us ; Max: 347.426us ; Number of samples: 1881) - DeserializeRowBatchTime: 128.001ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 899.011ms - TotalRPCsDeferred: 11 (11) HASH_JOIN_NODE (id=7):(Total: 31s244ms, non-child: 248.001ms, % non-child: 0.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s964ms - Open Started: 932.009ms (932.009ms) - Open Finished: 2s760ms (1s828ms) - First Batch Requested: 2s760ms (0.000ns) - First Batch Returned: 2s760ms (0.000ns) - Last Batch Returned: 40s964ms (38s204ms) - Closed: 40s964ms (0.000ns) - BuildRows: 365 (365) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 7.97 MB (8360192) - ProbeRows: 6.40M (6400586) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 244.001ms - RowsReturned: 6.40M (6400586) - RowsReturnedRate: 204.86 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.40M (6400951) - Resizes: 0 (0) - Travel: 2.14M (2135496) EXCHANGE_NODE (id=13): Node Lifecycle Event Timeline: 932.009ms - Open Started: 932.009ms (932.009ms) - Open Finished: 932.009ms (0.000ns) - First Batch Requested: 932.009ms (0.000ns) - First Batch Returned: 932.009ms (0.000ns) - Last Batch Returned: 932.009ms (0.000ns) - Closed: 932.009ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 15.363us ; Min: 15.363us ; Max: 15.363us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 30s996ms, non-child: 27s528ms, % non-child: 88.81%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s964ms - Open Started: 932.009ms (932.009ms) - Open Finished: 2s752ms (1s820ms) - First Batch Requested: 2s752ms (0.000ns) - First Batch Returned: 2s760ms (8.000ms) - Last Batch Returned: 40s964ms (38s204ms) - Closed: 40s964ms (0.000ns) - BuildRows: 9.17M (9173330) - BuildTime: 1s276ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 550.59M (550586740) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26s116ms - RowsReturned: 6.40M (6400586) - RowsReturnedRate: 206.50 K/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 836.009ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 440.005ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 546.81M (546805259) - Resizes: 0 (0) - Travel: 360.09M (360088662) EXCHANGE_NODE (id=12):(Total: 492.005ms, non-child: 132.001ms, % non-child: 26.83%) Node Lifecycle Event Timeline: 2s704ms - Open Started: 932.009ms (932.009ms) - Open Finished: 932.009ms (0.000ns) - First Batch Requested: 932.009ms (0.000ns) - First Batch Returned: 932.009ms (0.000ns) - Last Batch Returned: 2s264ms (1s332ms) - Closed: 2s704ms (440.005ms) - ConvertRowBatchTime: 112.001ms - PeakMemoryUsage: 13.12 MB (13758333) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 18.64 M/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 85.80 MB, 272.65 MB, 471.07 MB, 489.91 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 372.004ms - DataWaitTime: 360.004ms Enqueue: - BytesReceived (500.000ms): 4.53 MB, 4.53 MB, 37.40 MB, 118.82 MB, 205.24 MB, 213.42 MB - DeferredQueueSize (500.000ms): 8, 8, 0, 0, 0, 0 - DispatchTime: (Avg: 17.567us ; Min: 5.122us ; Max: 1.204ms ; Number of samples: 8969) - DeserializeRowBatchTime: 416.004ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 820.866ms - TotalRPCsDeferred: 9 (9) HDFS_SCAN_NODE (id=0):(Total: 2s976ms, non-child: 2s976ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/139.18 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 116 out of 116 Runtime filters: All filters arrived. Waited 0. Maximum arrival delay: 2s264ms. Hdfs Read Thread Concurrency Bucket: 0:78.75% 1:13.75% 2:6.25% 3:0% 4:1.25% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:116 PARQUET/Unknown(Skipped):482 Node Lifecycle Event Timeline: 40s964ms - Open Started: 932.009ms (932.009ms) - Open Finished: 932.009ms (0.000ns) - First Batch Requested: 2s704ms (1s772ms) - First Batch Returned: 2s752ms (48.000ms) - Last Batch Returned: 40s956ms (38s204ms) - Closed: 40s964ms (7.999ms) - BytesRead (1s000ms): 0, 0, 0, 691.21 MB, 859.27 MB, 1.02 GB, 1.28 GB, 1.60 GB, 1.93 GB, 2.08 GB, 2.33 GB, 2.54 GB, 3.08 GB, 3.20 GB, 3.42 GB, 3.74 GB, 4.01 GB, 4.24 GB, 4.62 GB, 4.85 GB, 5.11 GB, 5.33 GB, 5.66 GB, 5.94 GB, 6.26 GB, 6.46 GB, 6.73 GB, 7.03 GB, 7.32 GB, 7.51 GB, 7.94 GB, 8.14 GB, 8.34 GB, 8.67 GB, 8.96 GB, 9.27 GB, 9.50 GB, 9.78 GB, 9.99 GB, 10.18 GB, 10.34 GB - FooterProcessingTime: (Avg: 206.898us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 116) - InitialRangeActualReservation: (Avg: 56.28 MB (59009518) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 116) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 116) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.14 GB (1226484005) ; Min: 476.44 MB (499588180) ; Max: 2.02 GB (2170960123) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.62 KB (41598) ; Min: 12.00 B (12) ; Max: 71.37 KB (73084) ; Number of samples: 265357) - ParquetRowGroupActualReservation: (Avg: 58.34 MB (61178985) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 116) - ParquetRowGroupIdealReservation: (Avg: 119.28 MB (125069806) ; Min: 88.00 MB (92274688) ; Max: 136.00 MB (142606336) ; Number of samples: 116) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.82 GB (1950151983) ; Min: 489.52 MB (513303144) ; Max: 3.70 GB (3977888182) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.59 KB (66142) ; Min: 10.00 B (10) ; Max: 72.39 KB (74131) ; Number of samples: 265357) - AverageHdfsReadThreadConcurrency: 0.31 - AverageScannerThreadConcurrency: 12.14 - BytesRead: 10.41 GB (11173593845) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4.04K (4040) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.35 GB (11115548757) - DataCacheHitCount: 4.01K (4011) - DataCacheMissBytes: 55.36 MB (58045088) - DataCacheMissCount: 29 (29) - DataCachePartialHitCount: 21 (21) - DecompressionTime: 8s500ms - MaterializeTupleTime(*): 1m2s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 265.36K (265357) - NumRowGroups: 116 (116) - NumRowGroupsWithPageIndex: 116 (116) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 799.01 MB (837827401) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 718.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.80 GB (34145654784) - RowBatchQueueGetWaitTime: 80.000ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 6m42s - RowBatchesEnqueued: 537.94K (537937) - RowsRead: 550.67M (550668182) - RowsReturned: 550.59M (550586740) - RowsReturnedRate: 185.01 M/sec - ScanRangesComplete: 598 (598) - ScannerIoWaitTime: 10s264ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 771 (771) - ScannerThreadsTotalWallClockTime: 8m8s - ScannerThreadsSysTime: 16s164ms - ScannerThreadsUserTime: 1m2s - ScannerThreadsVoluntaryContextSwitches: 540.82K (540818) - TotalRawHdfsOpenFileTime(*): 24.000ms - TotalRawHdfsReadTime(*): 14s824ms - TotalReadThroughput: 259.14 MB/sec Buffer pool: - AllocTime: 300.002ms - CumulativeAllocationBytes: 6.16 GB (6618873856) - CumulativeAllocations: 1.28K (1285) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 724.00 MB (759169024) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 300.002ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1981986) - Rows rejected: 46.47K (46472) - Rows total: 550.67M (550668182) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935514) - Rows rejected: 23.21K (23214) - Rows total: 550.62M (550621710) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.91M (1912300) - Rows rejected: 11.76K (11756) - Rows total: 550.60M (550598496) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 598 (598) - Files rejected: 482 (482) - Files total: 598 (598) - RowGroups processed: 537.71K (537705) - RowGroups rejected: 0 (0) - RowGroups total: 537.71K (537705) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 550.59M (550586740) - Splits processed: 116 (116) - Splits rejected: 0 (0) - Splits total: 116 (116) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.90M (1900544) - Rows rejected: 0 (0) - Rows total: 550.59M (550586740) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 932.009ms, non-child: 932.009ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 932.009ms - CodegenSysTime: 7.993ms - CodegenUserTime: 923.251ms - CodegenVoluntaryContextSwitches: 10 (10) - CompileTime: 284.002ms - IrGenerationTime: 28.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 604.006ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 16.000ms Instance 2a45c19935b2f933:e73e987000000020 (host=impala-executor-000-3:22000):(Total: 40s423ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:11.257 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/138.94 GB Filter 0 arrival: 928ms Filter 2 arrival: 928ms Filter 6 arrival: 928ms Filter 4 arrival: 1s215ms Filter 8 arrival: 2s266ms Fragment Instance Lifecycle Event Timeline: 40s423ms - Prepare Finished: 3.999ms (3.999ms) - Open Finished: 40s419ms (40s415ms) - First Batch Produced: 40s423ms (3.999ms) - First Batch Sent: 40s423ms (0.000ns) - ExecInternal Finished: 40s423ms (0.000ns) - MemoryUsage (1s000ms): 40.11 MB, 328.15 MB, 745.12 MB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.60 GB, 1.41 GB - ThreadUsage (1s000ms): 1, 2, 2, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 10 - AverageThreadTokens: 12.91 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1785363504) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785363504) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 507.999ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 2s163ms - TotalThreadsInvoluntaryContextSwitches: 887 (887) - TotalThreadsTotalWallClockTime: 8m44s - TotalThreadsSysTime: 24s678ms - TotalThreadsUserTime: 1m34s - TotalThreadsVoluntaryContextSwitches: 545.89K (545892) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 3.999ms - ExecTreeExecTime: 3.999ms - OpenTime: 40s415ms - ExecTreeOpenTime: 39s495ms - PrepareTime: 3.999ms - ExecTreePrepareTime: 3.999ms KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 132.17 KB/sec ; Min: 132.17 KB/sec ; Max: 132.17 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 229.561us ; Min: 97.067us ; Max: 362.056us ; Number of samples: 2) - RpcRecvrTime: (Avg: 38.790us ; Min: 14.351us ; Max: 63.229us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 49.00 B (49) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 39s503ms, non-child: 6s519ms, % non-child: 16.50%) Node Lifecycle Event Timeline: 40s423ms - Open Started: 923.998ms (923.998ms) - Open Finished: 40s419ms (39s495ms) - First Batch Requested: 40s419ms (0.000ns) - First Batch Returned: 40s423ms (3.999ms) - Last Batch Returned: 40s423ms (0.000ns) - Closed: 40s423ms (0.000ns) - PeakMemoryUsage: 16.71 MB (17516544) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 3.999ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 32s983ms, non-child: 1s151ms, % non-child: 3.49%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s419ms - Open Started: 923.998ms (923.998ms) - Open Finished: 2s755ms (1s831ms) - First Batch Requested: 2s755ms (0.000ns) - First Batch Returned: 2s771ms (15.999ms) - Last Batch Returned: 40s419ms (37s647ms) - Closed: 40s419ms (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 17.93 MB (18804992) - ProbeRows: 6.35M (6350550) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s143ms - RowsReturned: 8.71K (8706) - RowsReturnedRate: 263.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 3.999ms - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.35M (6348421) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 927.998ms - Open Started: 923.998ms (923.998ms) - Open Finished: 923.998ms (0.000ns) - First Batch Requested: 923.998ms (0.000ns) - First Batch Returned: 923.998ms (0.000ns) - Last Batch Returned: 927.998ms (3.999ms) - Closed: 927.998ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 21.259us ; Min: 16.391us ; Max: 30.844us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 31s831ms, non-child: 239.999ms, % non-child: 0.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s419ms - Open Started: 923.998ms (923.998ms) - Open Finished: 2s755ms (1s831ms) - First Batch Requested: 2s755ms (0.000ns) - First Batch Returned: 2s755ms (0.000ns) - Last Batch Returned: 40s419ms (37s663ms) - Closed: 40s419ms (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 13.32 MB (13963520) - ProbeRows: 6.37M (6370268) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 231.999ms - RowsReturned: 6.35M (6350550) - RowsReturnedRate: 199.50 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.35M (6352050) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 927.998ms - Open Started: 923.998ms (923.998ms) - Open Finished: 923.998ms (0.000ns) - First Batch Requested: 927.998ms (3.999ms) - First Batch Returned: 927.998ms (0.000ns) - Last Batch Returned: 927.998ms (0.000ns) - Closed: 927.998ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 25.123us ; Min: 19.418us ; Max: 30.829us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 31s591ms, non-child: 871.998ms, % non-child: 2.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s419ms - Open Started: 923.998ms (923.998ms) - Open Finished: 2s755ms (1s831ms) - First Batch Requested: 2s755ms (0.000ns) - First Batch Returned: 2s755ms (0.000ns) - Last Batch Returned: 40s419ms (37s663ms) - Closed: 40s419ms (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 279.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 170.47 MB (178747648) - ProbeRows: 6.41M (6407129) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 855.998ms - RowsReturned: 6.37M (6370268) - RowsReturnedRate: 201.64 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 187.999ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 87.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.29M (8291068) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 99.999ms, non-child: 19.999ms, % non-child: 20.00%) Node Lifecycle Event Timeline: 1s303ms - Open Started: 923.998ms (923.998ms) - Open Finished: 923.998ms (0.000ns) - First Batch Requested: 927.998ms (3.999ms) - First Batch Returned: 927.998ms (0.000ns) - Last Batch Returned: 1s215ms (287.999ms) - Closed: 1s303ms (87.999ms) - ConvertRowBatchTime: 11.999ms - PeakMemoryUsage: 14.24 MB (14931360) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 19.21 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 64.24 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 83.999ms - DataWaitTime: 79.999ms Enqueue: - BytesReceived (500.000ms): 4.77 MB, 4.77 MB, 29.41 MB - DeferredQueueSize (500.000ms): 9, 9, 0 - DispatchTime: (Avg: 19.843us ; Min: 5.475us ; Max: 162.093us ; Number of samples: 1881) - DeserializeRowBatchTime: 91.999ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 888.832ms - TotalRPCsDeferred: 9 (9) HASH_JOIN_NODE (id=7):(Total: 30s719ms, non-child: 267.999ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s419ms - Open Started: 923.998ms (923.998ms) - Open Finished: 2s755ms (1s831ms) - First Batch Requested: 2s755ms (0.000ns) - First Batch Returned: 2s755ms (0.000ns) - Last Batch Returned: 40s419ms (37s663ms) - Closed: 40s419ms (0.000ns) - BuildRows: 365 (365) - BuildTime: 3.999ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 7.97 MB (8360192) - ProbeRows: 6.41M (6407129) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 259.999ms - RowsReturned: 6.41M (6407129) - RowsReturnedRate: 208.56 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.41M (6407494) - Resizes: 0 (0) - Travel: 2.16M (2157570) EXCHANGE_NODE (id=13): Node Lifecycle Event Timeline: 927.998ms - Open Started: 923.998ms (923.998ms) - Open Finished: 923.998ms (0.000ns) - First Batch Requested: 927.998ms (3.999ms) - First Batch Returned: 927.998ms (0.000ns) - Last Batch Returned: 927.998ms (0.000ns) - Closed: 927.998ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 28.522us ; Min: 28.522us ; Max: 28.522us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 30s451ms, non-child: 27s075ms, % non-child: 88.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s419ms - Open Started: 923.998ms (923.998ms) - Open Finished: 2s739ms (1s815ms) - First Batch Requested: 2s739ms (0.000ns) - First Batch Returned: 2s755ms (15.999ms) - Last Batch Returned: 40s419ms (37s663ms) - Closed: 40s419ms (0.000ns) - BuildRows: 9.17M (9173330) - BuildTime: 1s279ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 550.85M (550848442) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 25s615ms - RowsReturned: 6.41M (6407129) - RowsReturnedRate: 210.40 K/sec Buffer pool: - AllocTime: 3.999ms - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 839.998ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 431.999ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 547.09M (547086421) - Resizes: 0 (0) - Travel: 360.07M (360072504) EXCHANGE_NODE (id=12):(Total: 487.999ms, non-child: 67.999ms, % non-child: 13.93%) Node Lifecycle Event Timeline: 2s699ms - Open Started: 923.998ms (923.998ms) - Open Finished: 923.998ms (0.000ns) - First Batch Requested: 927.998ms (3.999ms) - First Batch Returned: 927.998ms (0.000ns) - Last Batch Returned: 2s263ms (1s335ms) - Closed: 2s699ms (435.999ms) - ConvertRowBatchTime: 63.999ms - PeakMemoryUsage: 13.05 MB (13683078) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 18.80 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 58.30 MB, 240.93 MB, 437.28 MB, 489.91 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 423.999ms - DataWaitTime: 419.999ms Enqueue: - BytesReceived (500.000ms): 2.17 MB, 4.48 MB, 25.42 MB, 104.98 MB, 190.49 MB, 213.42 MB - DeferredQueueSize (500.000ms): 0, 6, 0, 0, 0, 0 - DispatchTime: (Avg: 17.786us ; Min: 6.239us ; Max: 272.574us ; Number of samples: 8969) - DeserializeRowBatchTime: 391.999ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 810.841ms - TotalRPCsDeferred: 6 (6) HDFS_SCAN_NODE (id=0):(Total: 2s887ms, non-child: 2s887ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:598/138.94 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 118 out of 118 Runtime filters: All filters arrived. Waited 0. Maximum arrival delay: 2s266ms. Hdfs Read Thread Concurrency Bucket: 0:86.08% 1:6.329% 2:5.063% 3:0% 4:1.266% 5:0% 6:0% 7:1.266% 8:0% File Formats: PARQUET/SNAPPY:118 PARQUET/Unknown(Skipped):480 Node Lifecycle Event Timeline: 40s419ms - Open Started: 923.998ms (923.998ms) - Open Finished: 923.998ms (0.000ns) - First Batch Requested: 2s699ms (1s775ms) - First Batch Returned: 2s739ms (39.999ms) - Last Batch Returned: 40s415ms (37s675ms) - Closed: 40s419ms (3.999ms) - BytesRead (1s000ms): 0, 0, 0, 695.75 MB, 827.59 MB, 1.03 GB, 1.23 GB, 1.59 GB, 1.93 GB, 2.14 GB, 2.38 GB, 2.71 GB, 3.06 GB, 3.24 GB, 3.47 GB, 3.76 GB, 4.06 GB, 4.39 GB, 4.56 GB, 4.84 GB, 5.16 GB, 5.52 GB, 5.69 GB, 5.92 GB, 6.33 GB, 6.57 GB, 6.85 GB, 7.03 GB, 7.38 GB, 7.63 GB, 7.96 GB, 8.21 GB, 8.53 GB, 8.88 GB, 9.10 GB, 9.33 GB, 9.61 GB, 9.93 GB, 10.10 GB, 10.29 GB - FooterProcessingTime: (Avg: 237.287us ; Min: 0.000ns ; Max: 3.999ms ; Number of samples: 118) - InitialRangeActualReservation: (Avg: 55.73 MB (58435896) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 118) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 118) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.14 GB (1228050458) ; Min: 476.67 MB (499829041) ; Max: 2.02 GB (2171710149) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.68 KB (41655) ; Min: 11.00 B (11) ; Max: 70.03 KB (71709) ; Number of samples: 265332) - ParquetRowGroupActualReservation: (Avg: 57.76 MB (60568593) ; Min: 40.00 MB (41943040) ; Max: 128.00 MB (134217728) ; Number of samples: 118) - ParquetRowGroupIdealReservation: (Avg: 118.41 MB (124158507) ; Min: 88.00 MB (92274688) ; Max: 136.00 MB (142606336) ; Number of samples: 118) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.82 GB (1950353575) ; Min: 489.76 MB (513548196) ; Max: 3.70 GB (3975706732) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.60 KB (66155) ; Min: 9.00 B (9) ; Max: 70.85 KB (72550) ; Number of samples: 265332) - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 12.15 - BytesRead: 10.42 GB (11189914963) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4.23K (4230) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.38 GB (11141784633) - DataCacheHitCount: 4.22K (4223) - DataCacheMissBytes: 45.90 MB (48130330) - DataCacheMissCount: 8 (8) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 8s807ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 265.33K (265332) - NumRowGroups: 118 (118) - NumRowGroupsWithPageIndex: 118 (118) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 799.12 MB (837937281) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.82 GB (34161852416) - RowBatchQueueGetWaitTime: 75.999ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 6m43s - RowBatchesEnqueued: 538.19K (538194) - RowsRead: 550.93M (550932018) - RowsReturned: 550.85M (550848442) - RowsReturnedRate: 190.74 M/sec - ScanRangesComplete: 598 (598) - ScannerIoWaitTime: 2s163ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 810 (810) - ScannerThreadsTotalWallClockTime: 8m1s - ScannerThreadsSysTime: 16s294ms - ScannerThreadsUserTime: 1m2s - ScannerThreadsVoluntaryContextSwitches: 541.35K (541349) - TotalRawHdfsOpenFileTime(*): 79.999ms - TotalRawHdfsReadTime(*): 9s747ms - TotalReadThroughput: 262.71 MB/sec Buffer pool: - AllocTime: 579.999ms - CumulativeAllocationBytes: 6.23 GB (6693584896) - CumulativeAllocations: 1.33K (1334) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 722.00 MB (757071872) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 575.999ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2016888) - Rows rejected: 47.81K (47813) - Rows total: 550.93M (550932018) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1969075) - Rows rejected: 23.84K (23837) - Rows total: 550.88M (550884205) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1945238) - Rows rejected: 11.93K (11926) - Rows total: 550.86M (550860368) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 598 (598) - Files rejected: 480 (480) - Files total: 598 (598) - RowGroups processed: 537.96K (537958) - RowGroups rejected: 0 (0) - RowGroups total: 537.96K (537958) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 550.85M (550848442) - Splits processed: 118 (118) - Splits rejected: 0 (0) - Splits total: 118 (118) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1933312) - Rows rejected: 0 (0) - Rows total: 550.85M (550848442) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 919.998ms, non-child: 919.998ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 3 (3) - CodegenTotalWallClockTime: 919.998ms - CodegenSysTime: 7.978ms - CodegenUserTime: 911.781ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 279.999ms - IrGenerationTime: 31.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 595.999ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 11.999ms Instance 2a45c19935b2f933:e73e98700000001a (host=impala-executor-000-8:22000):(Total: 40s300ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:03:11.136 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:599/138.92 GB Filter 0 arrival: 921ms Filter 2 arrival: 922ms Filter 6 arrival: 922ms Filter 4 arrival: 1s214ms Filter 8 arrival: 2s265ms Fragment Instance Lifecycle Event Timeline: 40s300ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 40s300ms (40s300ms) - First Batch Produced: 40s300ms (0.000ns) - First Batch Sent: 40s300ms (0.000ns) - ExecInternal Finished: 40s300ms (0.000ns) - MemoryUsage (1s000ms): 43.40 MB, 328.15 MB, 753.12 MB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.65 GB, 1.63 GB, 1.45 GB - ThreadUsage (1s000ms): 1, 2, 2, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 10 - AverageThreadTokens: 12.88 - BloomFilterBytes: 6.00 MB (6291456) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.66 GB (1785946346) - PeakReservation: 1.60 GB (1715273728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1785946346) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 456.001ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 3s580ms - TotalThreadsInvoluntaryContextSwitches: 887 (887) - TotalThreadsTotalWallClockTime: 8m43s - TotalThreadsSysTime: 23s938ms - TotalThreadsUserTime: 1m34s - TotalThreadsVoluntaryContextSwitches: 544.54K (544537) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 5 (5) - PeakReservation: 6.00 MB (6291456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 6.00 MB (6291456) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 40s300ms - ExecTreeOpenTime: 39s384ms - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=17): ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 122.88 KB/sec ; Min: 122.88 KB/sec ; Max: 122.88 KB/sec ; Number of samples: 1) - RpcNetworkTime: (Avg: 243.522us ; Min: 81.719us ; Max: 405.325us ; Number of samples: 2) - RpcRecvrTime: (Avg: 49.518us ; Min: 16.772us ; Max: 82.264us ; Number of samples: 2) - EosSent: 1 (1) - PeakMemoryUsage: 1.58 KB (1616) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 51.00 B (51) - UncompressedRowBatchSize: 89.00 B (89) AGGREGATION_NODE (id=11):(Total: 39s384ms, non-child: 6s100ms, % non-child: 15.49%) Node Lifecycle Event Timeline: 40s300ms - Open Started: 916.002ms (916.002ms) - Open Finished: 40s300ms (39s384ms) - First Batch Requested: 40s300ms (0.000ns) - First Batch Returned: 40s300ms (0.000ns) - Last Batch Returned: 40s300ms (0.000ns) - Closed: 40s300ms (0.000ns) - PeakMemoryUsage: 16.40 MB (17199104) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=10):(Total: 33s284ms, non-child: 1s200ms, % non-child: 3.61%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s300ms - Open Started: 916.002ms (916.002ms) - Open Finished: 2s768ms (1s852ms) - First Batch Requested: 2s768ms (0.000ns) - First Batch Returned: 2s776ms (8.000ms) - Last Batch Returned: 40s300ms (37s524ms) - Closed: 40s300ms (0.000ns) - BuildRows: 7.20K (7200) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 12.90 MB (13531392) - ProbeRows: 6.34M (6336576) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s196ms - RowsReturned: 9.51K (9511) - RowsReturnedRate: 285.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.25 MB (1310720) - CumulativeAllocations: 20 (20) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.25 MB (1310720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 7.20K (7200) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 6.34M (6335068) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=16): Node Lifecycle Event Timeline: 920.002ms - Open Started: 916.002ms (916.002ms) - Open Finished: 916.002ms (0.000ns) - First Batch Requested: 916.002ms (0.000ns) - First Batch Returned: 916.002ms (0.000ns) - Last Batch Returned: 916.002ms (0.000ns) - Closed: 920.002ms (4.000ms) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 184.00 KB (188416) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 184.00 KB (188416) - CumulativeAllocations: 16 (16) - PeakReservation: 184.00 KB (188416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 184.00 KB (188416) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 147.66 KB (151200) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 56.68 KB, 56.68 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 21.478us ; Min: 15.225us ; Max: 39.219us ; Number of samples: 8) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 8 (8) - TotalBatchesReceived: 8 (8) - TotalBytesReceived: 56.68 KB (58041) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=9):(Total: 32s084ms, non-child: 292.001ms, % non-child: 0.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s300ms - Open Started: 916.002ms (916.002ms) - Open Finished: 2s760ms (1s844ms) - First Batch Requested: 2s760ms (0.000ns) - First Batch Returned: 2s768ms (8.000ms) - Last Batch Returned: 40s300ms (37s532ms) - Closed: 40s300ms (0.000ns) - BuildRows: 1.50K (1500) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 12.89 MB (13519104) - ProbeRows: 6.36M (6356368) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 288.001ms - RowsReturned: 6.34M (6336576) - RowsReturnedRate: 197.50 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 4.000ms - BuildRowsPartitioned: 1.50K (1500) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 6.34M (6338076) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=15): Node Lifecycle Event Timeline: 920.002ms - Open Started: 916.002ms (916.002ms) - Open Finished: 916.002ms (0.000ns) - First Batch Requested: 916.002ms (0.000ns) - First Batch Returned: 916.002ms (0.000ns) - Last Batch Returned: 920.002ms (4.000ms) - Closed: 920.002ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 40.00 KB (40960) - CumulativeAllocations: 4 (4) - PeakReservation: 40.00 KB (40960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 40.00 KB (40960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 24.90 KB (25500) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 11.73 KB, 11.73 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 26.598us ; Min: 24.061us ; Max: 29.136us ; Number of samples: 2) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 11.73 KB (12016) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=8):(Total: 31s792ms, non-child: 888.003ms, % non-child: 2.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s300ms - Open Started: 916.002ms (916.002ms) - Open Finished: 2s756ms (1s840ms) - First Batch Requested: 2s756ms (0.000ns) - First Batch Returned: 2s760ms (4.000ms) - Last Batch Returned: 40s300ms (37s540ms) - Closed: 40s300ms (0.000ns) - BuildRows: 1.92M (1920800) - BuildTime: 240.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 170.29 MB (178561280) - ProbeRows: 6.40M (6395717) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 880.003ms - RowsReturned: 6.36M (6356368) - RowsReturnedRate: 199.94 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 160.00 MB (167772160) - CumulativeAllocations: 64 (64) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 152.000ms - BuildRowsPartitioned: 1.92M (1920800) - HashTablesBuildTime: 84.000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.19M (4194304) - HashCollisions: 0 (0) - Probes: 8.28M (8277168) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=14):(Total: 140.000ms, non-child: 48.000ms, % non-child: 34.29%) Node Lifecycle Event Timeline: 1s296ms - Open Started: 916.002ms (916.002ms) - Open Finished: 916.002ms (0.000ns) - First Batch Requested: 920.002ms (4.000ms) - First Batch Returned: 920.002ms (0.000ns) - Last Batch Returned: 1s212ms (292.000ms) - Closed: 1s296ms (84.000ms) - ConvertRowBatchTime: 48.000ms - PeakMemoryUsage: 14.29 MB (14979925) - RowsReturned: 1.92M (1920800) - RowsReturnedRate: 13.72 M/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 131.96 MB (138371072) - CumulativeAllocations: 3.76K (3762) - PeakReservation: 14.05 MB (14737408) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 14.05 MB (14737408) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 70.99 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 94.47 MB (99058400) - TotalGetBatchTime: 92.000ms - DataWaitTime: 92.000ms Enqueue: - BytesReceived (500.000ms): 4.79 MB, 4.79 MB, 33.29 MB - DeferredQueueSize (500.000ms): 10, 10, 0 - DispatchTime: (Avg: 18.743us ; Min: 6.396us ; Max: 113.290us ; Number of samples: 1881) - DeserializeRowBatchTime: 104.000ms - TotalBatchesEnqueued: 1.88K (1881) - TotalBatchesReceived: 1.88K (1881) - TotalBytesReceived: 43.22 MB (45319091) - TotalEarlySenders: 0 (0) - TotalEosReceived: 10 (10) - TotalHasDeferredRPCsTime: 882.835ms - TotalRPCsDeferred: 11 (11) HASH_JOIN_NODE (id=7):(Total: 30s904ms, non-child: 244.000ms, % non-child: 0.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s300ms - Open Started: 916.002ms (916.002ms) - Open Finished: 2s756ms (1s840ms) - First Batch Requested: 2s756ms (0.000ns) - First Batch Returned: 2s756ms (0.000ns) - Last Batch Returned: 40s300ms (37s544ms) - Closed: 40s300ms (0.000ns) - BuildRows: 365 (365) - BuildTime: 4.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 7.91 MB (8296704) - ProbeRows: 6.40M (6395717) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 240.000ms - RowsReturned: 6.40M (6395717) - RowsReturnedRate: 206.95 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 365 (365) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 768 (768) - HashCollisions: 0 (0) - Probes: 6.40M (6396082) - Resizes: 0 (0) - Travel: 1.53M (1534094) EXCHANGE_NODE (id=13): Node Lifecycle Event Timeline: 920.002ms - Open Started: 916.002ms (916.002ms) - Open Finished: 916.002ms (0.000ns) - First Batch Requested: 920.002ms (4.000ms) - First Batch Returned: 920.002ms (0.000ns) - Last Batch Returned: 920.002ms (0.000ns) - Closed: 920.002ms (0.000ns) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 365 (365) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 7.49 KB (7665) - TotalGetBatchTime: 0.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 2.87 KB, 2.87 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 15.347us ; Min: 15.347us ; Max: 15.347us ; Number of samples: 1) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 2.87 KB (2939) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=6):(Total: 30s660ms, non-child: 27s440ms, % non-child: 89.50%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 40s300ms - Open Started: 916.002ms (916.002ms) - Open Finished: 2s748ms (1s832ms) - First Batch Requested: 2s748ms (0.000ns) - First Batch Returned: 2s756ms (8.000ms) - Last Batch Returned: 40s300ms (37s544ms) - Closed: 40s300ms (0.000ns) - BuildRows: 9.17M (9173330) - BuildTime: 1s320ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 704.16 MB (738363648) - ProbeRows: 549.03M (549031152) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 25s980ms - RowsReturned: 6.40M (6395717) - RowsReturnedRate: 208.60 K/sec Buffer pool: - AllocTime: 8.000ms - CumulativeAllocationBytes: 704.00 MB (738197504) - CumulativeAllocations: 240 (240) - PeakReservation: 704.00 MB (738197504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 704.00 MB (738197504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 8.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 1 Runtime Filter Published, 1 Disabled - BuildRowsPartitionTime: 880.002ms - BuildRowsPartitioned: 9.17M (9173330) - HashTablesBuildTime: 436.001ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.78M (16777216) - HashCollisions: 0 (0) - Probes: 545.32M (545316805) - Resizes: 0 (0) - Travel: 358.88M (358883704) EXCHANGE_NODE (id=12):(Total: 460.001ms, non-child: 96.000ms, % non-child: 20.87%) Node Lifecycle Event Timeline: 2s700ms - Open Started: 916.002ms (916.002ms) - Open Finished: 916.002ms (0.000ns) - First Batch Requested: 920.002ms (4.000ms) - First Batch Returned: 920.002ms (0.000ns) - Last Batch Returned: 2s264ms (1s344ms) - Closed: 2s700ms (436.001ms) - ConvertRowBatchTime: 92.000ms - PeakMemoryUsage: 13.05 MB (13683074) - RowsReturned: 9.17M (9173330) - RowsReturnedRate: 19.94 M/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 630.01 MB (660611072) - CumulativeAllocations: 17.94K (17938) - PeakReservation: 12.93 MB (13557760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.93 MB (13557760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 64.04 MB, 248.37 MB, 446.25 MB, 489.91 MB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 489.91 MB (513706480) - TotalGetBatchTime: 364.001ms - DataWaitTime: 364.001ms Enqueue: - BytesReceived (500.000ms): 4.48 MB, 4.48 MB, 28.13 MB, 108.22 MB, 194.42 MB, 213.42 MB - DeferredQueueSize (500.000ms): 6, 6, 0, 0, 0, 0 - DispatchTime: (Avg: 15.483us ; Min: 5.436us ; Max: 405.884us ; Number of samples: 8969) - DeserializeRowBatchTime: 456.001ms - TotalBatchesEnqueued: 8.97K (8969) - TotalBatchesReceived: 8.97K (8969) - TotalBytesReceived: 213.42 MB (223784331) - TotalEarlySenders: 0 (0) - TotalEosReceived: 9 (9) - TotalHasDeferredRPCsTime: 803.704ms - TotalRPCsDeferred: 6 (6) HDFS_SCAN_NODE (id=0):(Total: 2s760ms, non-child: 2s760ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:599/138.92 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 115 out of 115 Runtime filters: All filters arrived. Waited 0. Maximum arrival delay: 2s265ms. Hdfs Read Thread Concurrency Bucket: 0:87.34% 1:7.595% 2:2.532% 3:0% 4:2.532% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:115 PARQUET/Unknown(Skipped):484 Node Lifecycle Event Timeline: 40s300ms - Open Started: 916.002ms (916.002ms) - Open Finished: 916.002ms (0.000ns) - First Batch Requested: 2s700ms (1s784ms) - First Batch Returned: 2s748ms (48.000ms) - Last Batch Returned: 40s296ms (37s548ms) - Closed: 40s300ms (4.000ms) - BytesRead (1s000ms): 0, 0, 0, 692.12 MB, 806.32 MB, 1.02 GB, 1.22 GB, 1.59 GB, 1.90 GB, 2.13 GB, 2.36 GB, 2.74 GB, 3.01 GB, 3.19 GB, 3.46 GB, 3.71 GB, 4.09 GB, 4.30 GB, 4.57 GB, 4.81 GB, 5.18 GB, 5.42 GB, 5.60 GB, 6.02 GB, 6.28 GB, 6.53 GB, 6.86 GB, 7.08 GB, 7.40 GB, 7.62 GB, 7.97 GB, 8.16 GB, 8.45 GB, 8.81 GB, 9.02 GB, 9.32 GB, 9.57 GB, 9.92 GB, 10.09 GB, 10.29 GB - FooterProcessingTime: (Avg: 278.261us ; Min: 0.000ns ; Max: 4.000ms ; Number of samples: 115) - InitialRangeActualReservation: (Avg: 56.70 MB (59449700) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 115) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 115) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.14 GB (1222201406) ; Min: 475.06 MB (498139840) ; Max: 2.02 GB (2164928141) ; Number of samples: 9) - ParquetCompressedPageSize: (Avg: 40.58 KB (41556) ; Min: 11.00 B (11) ; Max: 70.60 KB (72293) ; Number of samples: 264693) - ParquetRowGroupActualReservation: (Avg: 58.78 MB (61638032) ; Min: 40.00 MB (41943040) ; Max: 136.00 MB (142606336) ; Number of samples: 115) - ParquetRowGroupIdealReservation: (Avg: 121.29 MB (127178591) ; Min: 88.00 MB (92274688) ; Max: 136.00 MB (142606336) ; Number of samples: 115) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.81 GB (1945185217) ; Min: 488.07 MB (511778810) ; Max: 3.70 GB (3969883094) ; Number of samples: 9) - ParquetUncompressedPageSize: (Avg: 64.59 KB (66139) ; Min: 9.00 B (9) ; Max: 71.65 KB (73365) ; Number of samples: 264693) - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 12.11 - BytesRead: 10.37 GB (11133927420) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4.17K (4169) - CachedFileHandlesMissCount: 2 (2) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 10.32 GB (11080567647) - DataCacheHitCount: 4.16K (4163) - DataCacheMissBytes: 50.89 MB (53359773) - DataCacheMissCount: 8 (8) - DataCachePartialHitCount: 2 (2) - DecompressionTime: 8s452ms - MaterializeTupleTime(*): 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 9 (9) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 264.69K (264693) - NumRowGroups: 115 (115) - NumRowGroupsWithPageIndex: 115 (115) - NumScannerThreadMemUnavailable: 1 (1) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 13 (13) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 799.43 MB (838263871) - PeakScannerThreadConcurrency: 13 (13) - PerReadThreadRawHdfsThroughput: 1006.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 31.71 GB (34048958464) - RowBatchQueueGetWaitTime: 52.000ms - RowBatchQueuePeakMemoryUsage: 6.42 MB (6729728) - RowBatchQueuePutWaitTime: 6m42s - RowBatchesEnqueued: 536.41K (536413) - RowsRead: 549.11M (549111967) - RowsReturned: 549.03M (549031152) - RowsReturnedRate: 198.92 M/sec - ScanRangesComplete: 599 (599) - ScannerIoWaitTime: 3s580ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 805 (805) - ScannerThreadsTotalWallClockTime: 8m - ScannerThreadsSysTime: 16s078ms - ScannerThreadsUserTime: 1m1s - ScannerThreadsVoluntaryContextSwitches: 540.38K (540379) - TotalRawHdfsOpenFileTime(*): 116.000ms - TotalRawHdfsReadTime(*): 10s552ms - TotalReadThroughput: 262.03 MB/sec Buffer pool: - AllocTime: 408.001ms - CumulativeAllocationBytes: 6.11 GB (6555566080) - CumulativeAllocations: 1.29K (1292) - PeakReservation: 760.00 MB (796917760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 715.25 MB (749993984) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 408.001ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.96M (1964975) - Rows rejected: 46.01K (46011) - Rows total: 549.11M (549111967) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 2 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.92M (1918964) - Rows rejected: 23.24K (23237) - Rows total: 549.07M (549065956) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.90M (1895727) - Rows rejected: 11.57K (11567) - Rows total: 549.04M (549042719) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 6 (1.00 MB): - Files processed: 599 (599) - Files rejected: 484 (484) - Files total: 599 (599) - RowGroups processed: 536.18K (536183) - RowGroups rejected: 0 (0) - RowGroups total: 536.18K (536183) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 549.03M (549031152) - Splits processed: 115 (115) - Splits rejected: 0 (0) - Splits total: 115 (115) Filter 8 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.88M (1884160) - Rows rejected: 0 (0) - Rows total: 549.03M (549031152) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 916.002ms, non-child: 916.002ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 3 (3) - CodegenTotalWallClockTime: 916.002ms - CodegenSysTime: 0.000ns - CodegenUserTime: 915.791ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 280.000ms - IrGenerationTime: 32.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 344 (344) - NumInstructions: 20.02K (20025) - OptimizationTime: 592.001ms - PeakMemoryUsage: 9.78 MB (10252800) - PrepareTime: 12.000ms Averaged Fragment F01:(Total: 2s068ms, non-child: 13.333ms, % non-child: 0.64%) split sizes: min: 29.99 MB, max: 89.95 MB, avg: 66.63 MB, stddev: 18.84 MB completion times: min:5s008ms max:5s012ms mean: 5s011ms stddev:1.257ms execution rates: min:5.98 MB/sec max:17.95 MB/sec mean:13.30 MB/sec stddev:3.76 MB/sec num instances: 9 - AverageThreadTokens: 3.16 - BloomFilterBytes: 0 - ExchangeScanRatio: 13.90 - PeakMemoryUsage: 34.29 MB (35955658) - PeakReservation: 22.50 MB (23592960) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1781679884) - RowsProduced: 1.02M (1019258) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s712ms - TotalStorageWaitTime: 4.000ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 6s419ms - TotalThreadsSysTime: 67.208ms - TotalThreadsUserTime: 500.919ms - TotalThreadsVoluntaryContextSwitches: 2.07K (2066) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s966ms - ExecTreeExecTime: 13.333ms - OpenTime: 101.777ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12):(Total: 1s941ms, non-child: 1s941ms, % non-child: 100.00%) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 1.02M (1019258) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 159.555ms - TotalBytesSent: 237.13 MB (248649256) - UncompressedRowBatchSize: 544.34 MB (570784977) HDFS_SCAN_NODE (id=4):(Total: 12.000ms, non-child: 12.000ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.22 - BytesRead: 17.06 MB (17890628) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 11 (11) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 17.06 MB (17890628) - DataCacheHitCount: 11 (11) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 42.666ms - MaterializeTupleTime(*): 152.889ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 486 (486) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 34.12 MB (35775367) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 959.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 116.57 MB (122227909) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 10.45 MB (10959558) - RowBatchQueuePutWaitTime: 4s137ms - RowBatchesEnqueued: 1.00K (1000) - RowsRead: 3.61M (3611111) - RowsReturned: 1.02M (1019258) - RowsReturnedRate: 94.49 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 4.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 4s350ms - ScannerThreadsSysTime: 15.383ms - ScannerThreadsUserTime: 195.541ms - ScannerThreadsVoluntaryContextSwitches: 929 (929) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 4.000ms - TotalReadThroughput: 8.16 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 22.78 MB (23884231) - CumulativeAllocations: 8 (8) - PeakReservation: 22.50 MB (23592960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 22.50 MB (23592960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 101.777ms, non-child: 101.777ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 101.777ms - CodegenSysTime: 1.355ms - CodegenUserTime: 99.299ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 18.222ms - IrGenerationTime: 2.222ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 55 (55) - NumInstructions: 1.40K (1400) - OptimizationTime: 66.666ms - PeakMemoryUsage: 700.00 KB (716800) - PrepareTime: 14.222ms Fragment F01: Instance 2a45c19935b2f933:e73e987000000002 (host=impala-executor-000-9:22000):(Total: 2s264ms, non-child: 12.000ms, % non-child: 0.53%) Last report received time: 2019-11-21 23:02:35.839 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.94 MB Fragment Instance Lifecycle Event Timeline: 2s264ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 100.000ms (100.000ms) - First Batch Produced: 104.000ms (4.000ms) - First Batch Sent: 104.000ms (0.000ns) - ExecInternal Finished: 2s264ms (2s160ms) - MemoryUsage (500.000ms): 42.48 MB, 42.48 MB, 42.44 MB, 42.51 MB, 42.43 MB - ThreadUsage (500.000ms): 4, 4, 4, 4, 4 - AverageThreadTokens: 4.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 13.89 - PeakMemoryUsage: 42.79 MB (44872735) - PeakReservation: 30.38 MB (31850496) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782978636) - RowsProduced: 1.38M (1375203) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s804ms - TotalStorageWaitTime: 12.000ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 8s616ms - TotalThreadsSysTime: 86.226ms - TotalThreadsUserTime: 639.713ms - TotalThreadsVoluntaryContextSwitches: 2.85K (2853) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 2s164ms - ExecTreeExecTime: 8.000ms - OpenTime: 100.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12):(Total: 2s144ms, non-child: 340.002ms, % non-child: 15.86%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 5.86 MB, 5.86 MB, 44.43 MB, 137.59 MB, 295.23 MB - NetworkThroughput: (Avg: 106.98 MB/sec ; Min: 13.45 MB/sec ; Max: 353.96 MB/sec ; Number of samples: 13450) - RpcNetworkTime: (Avg: 252.211us ; Min: 18.621us ; Max: 1.523ms ; Number of samples: 13460) - RpcRecvrTime: (Avg: 381.411us ; Min: 11.745us ; Max: 832.704ms ; Number of samples: 13460) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 1.38M (1375203) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 220.001ms - TotalBytesSent: 319.95 MB (335489640) - UncompressedRowBatchSize: 734.44 MB (770113680) HDFS_SCAN_NODE (id=4):(Total: 8.000ms, non-child: 8.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.94 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:3 Node Lifecycle Event Timeline: 2s264ms - Open Started: 100.000ms (100.000ms) - Open Finished: 100.000ms (0.000ns) - First Batch Requested: 100.000ms (0.000ns) - First Batch Returned: 104.000ms (4.000ms) - Last Batch Returned: 2s264ms (2s160ms) - Closed: 2s264ms (0.000ns) - BytesRead (500.000ms): 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 3) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - ParquetCompressedBytesReadPerColumn: (Avg: 7.39 MB (7744267) ; Min: 272.14 KB (278668) ; Max: 18.39 MB (19287183) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.53 KB (35361) ; Min: 4.49 KB (4595) ; Max: 64.14 KB (65683) ; Number of samples: 657) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetUncompressedBytesReadPerColumn: (Avg: 13.47 MB (14127477) ; Min: 420.78 KB (430876) ; Max: 36.51 MB (38284947) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.00 KB (64509) ; Min: 6.55 KB (6708) ; Max: 64.14 KB (65675) ; Number of samples: 657) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 23.03 MB (24151393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 23.03 MB (24151393) - DataCacheHitCount: 15 (15) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 44.000ms - MaterializeTupleTime(*): 236.001ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 657 (657) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 42.59 MB (44655831) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 1.87 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 157.35 MB (164993485) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 10.63 MB (11146623) - RowBatchQueuePutWaitTime: 6s048ms - RowBatchesEnqueued: 1.35K (1350) - RowsRead: 4.88M (4875000) - RowsReturned: 1.38M (1375203) - RowsReturnedRate: 171.90 M/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 12.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 6s352ms - ScannerThreadsSysTime: 14.965ms - ScannerThreadsUserTime: 268.411ms - ScannerThreadsVoluntaryContextSwitches: 1.29K (1286) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 12.000ms - TotalReadThroughput: 9.21 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 30.75 MB (32243712) - CumulativeAllocations: 12 (12) - PeakReservation: 30.38 MB (31850496) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 30.38 MB (31850496) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 100.000ms, non-child: 100.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 100.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 98.157ms - CodegenVoluntaryContextSwitches: 3 (3) - CompileTime: 16.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 55 (55) - NumInstructions: 1.40K (1400) - OptimizationTime: 64.000ms - PeakMemoryUsage: 700.00 KB (716800) - PrepareTime: 16.000ms Instance 2a45c19935b2f933:e73e987000000005 (host=impala-executor-000-7:22000):(Total: 2s263ms, non-child: 11.999ms, % non-child: 0.53%) Last report received time: 2019-11-21 23:02:35.836 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.95 MB Fragment Instance Lifecycle Event Timeline: 2s267ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 99.999ms (99.999ms) - First Batch Produced: 103.999ms (3.999ms) - First Batch Sent: 103.999ms (0.000ns) - ExecInternal Finished: 2s267ms (2s163ms) - MemoryUsage (500.000ms): 46.75 KB, 42.38 MB, 42.38 MB, 42.41 MB, 42.48 MB - ThreadUsage (500.000ms): 1, 4, 4, 4, 4 - AverageThreadTokens: 3.40 - BloomFilterBytes: 0 - ExchangeScanRatio: 13.89 - PeakMemoryUsage: 42.73 MB (44807119) - PeakReservation: 30.38 MB (31850496) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1777874705) - RowsProduced: 1.38M (1375554) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s823ms - TotalStorageWaitTime: 7.999ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 8s623ms - TotalThreadsSysTime: 85.091ms - TotalThreadsUserTime: 636.887ms - TotalThreadsVoluntaryContextSwitches: 2.92K (2916) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 2s163ms - ExecTreeExecTime: 15.999ms - OpenTime: 99.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12):(Total: 2s139ms, non-child: 315.998ms, % non-child: 14.77%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 6.48 MB, 25.80 MB, 113.97 MB, 229.66 MB - NetworkThroughput: (Avg: 111.54 MB/sec ; Min: 8.36 MB/sec ; Max: 350.59 MB/sec ; Number of samples: 13440) - RpcNetworkTime: (Avg: 242.349us ; Min: -9332.000ns ; Max: 2.850ms ; Number of samples: 13450) - RpcRecvrTime: (Avg: 627.642us ; Min: 14.122us ; Max: 860.666ms ; Number of samples: 13450) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 1.38M (1375554) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 183.998ms - TotalBytesSent: 320.04 MB (335581540) - UncompressedRowBatchSize: 734.63 MB (770310240) HDFS_SCAN_NODE (id=4):(Total: 11.999ms, non-child: 11.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:3 Node Lifecycle Event Timeline: 2s263ms - Open Started: 99.999ms (99.999ms) - Open Finished: 99.999ms (0.000ns) - First Batch Requested: 99.999ms (0.000ns) - First Batch Returned: 103.999ms (3.999ms) - Last Batch Returned: 2s263ms (2s159ms) - Closed: 2s263ms (0.000ns) - BytesRead (500.000ms): 0, 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 3) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - ParquetCompressedBytesReadPerColumn: (Avg: 7.39 MB (7744437) ; Min: 272.24 KB (278776) ; Max: 18.39 MB (19287584) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.53 KB (35362) ; Min: 4.43 KB (4540) ; Max: 64.14 KB (65683) ; Number of samples: 657) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetUncompressedBytesReadPerColumn: (Avg: 13.47 MB (14127251) ; Min: 420.11 KB (430197) ; Max: 36.51 MB (38284947) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.00 KB (64507) ; Min: 6.48 KB (6634) ; Max: 64.14 KB (65675) ; Number of samples: 657) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 23.03 MB (24152459) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 23.03 MB (24152459) - DataCacheHitCount: 15 (15) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 59.999ms - MaterializeTupleTime(*): 203.998ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 657 (657) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 42.55 MB (44621933) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 2.81 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 157.35 MB (164992806) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 10.63 MB (11146692) - RowBatchQueuePutWaitTime: 6s071ms - RowBatchesEnqueued: 1.35K (1350) - RowsRead: 4.88M (4875000) - RowsReturned: 1.38M (1375554) - RowsReturnedRate: 114.63 M/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 7.999ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 6s359ms - ScannerThreadsSysTime: 4.147ms - ScannerThreadsUserTime: 282.433ms - ScannerThreadsVoluntaryContextSwitches: 1.29K (1293) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 7.999ms - TotalReadThroughput: 9.21 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 30.75 MB (32243712) - CumulativeAllocations: 12 (12) - PeakReservation: 30.38 MB (31850496) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 30.38 MB (31850496) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 99.999ms, non-child: 99.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 99.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 99.648ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 19.999ms - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 55 (55) - NumInstructions: 1.40K (1400) - OptimizationTime: 63.999ms - PeakMemoryUsage: 700.00 KB (716800) - PrepareTime: 11.999ms Instance 2a45c19935b2f933:e73e987000000004 (host=impala-executor-000-0:22000):(Total: 2s259ms, non-child: 19.999ms, % non-child: 0.88%) Last report received time: 2019-11-21 23:02:35.841 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.95 MB Fragment Instance Lifecycle Event Timeline: 2s259ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 107.999ms (107.999ms) - First Batch Produced: 115.999ms (7.999ms) - First Batch Sent: 115.999ms (0.000ns) - ExecInternal Finished: 2s259ms (2s143ms) - MemoryUsage (500.000ms): 42.48 MB, 42.48 MB, 42.48 MB, 42.44 MB - ThreadUsage (500.000ms): 4, 4, 4, 4 - AverageThreadTokens: 4.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 13.89 - PeakMemoryUsage: 42.79 MB (44871879) - PeakReservation: 30.38 MB (31850496) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1778624685) - RowsProduced: 1.38M (1375361) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s795ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 8s603ms - TotalThreadsSysTime: 112.984ms - TotalThreadsUserTime: 641.434ms - TotalThreadsVoluntaryContextSwitches: 2.96K (2963) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 2s151ms - ExecTreeExecTime: 15.999ms - OpenTime: 107.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12):(Total: 2s115ms, non-child: 319.999ms, % non-child: 15.12%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0, 63.67 MB, 160.28 MB - NetworkThroughput: (Avg: 111.16 MB/sec ; Min: 5.51 MB/sec ; Max: 352.92 MB/sec ; Number of samples: 13450) - RpcNetworkTime: (Avg: 242.237us ; Min: 35.943us ; Max: 3.997ms ; Number of samples: 13460) - RpcRecvrTime: (Avg: 744.163us ; Min: 13.523us ; Max: 860.250ms ; Number of samples: 13460) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 1.38M (1375361) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 223.999ms - TotalBytesSent: 319.99 MB (335529650) - UncompressedRowBatchSize: 734.52 MB (770202160) HDFS_SCAN_NODE (id=4):(Total: 15.999ms, non-child: 15.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/89.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:3 Node Lifecycle Event Timeline: 2s259ms - Open Started: 107.999ms (107.999ms) - Open Finished: 107.999ms (0.000ns) - First Batch Requested: 107.999ms (0.000ns) - First Batch Returned: 115.999ms (7.999ms) - Last Batch Returned: 2s255ms (2s139ms) - Closed: 2s259ms (3.999ms) - BytesRead (500.000ms): 23.03 MB, 23.03 MB, 23.03 MB, 23.03 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 3) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - ParquetCompressedBytesReadPerColumn: (Avg: 7.39 MB (7744696) ; Min: 271.31 KB (277818) ; Max: 18.40 MB (19289320) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.53 KB (35363) ; Min: 4.49 KB (4593) ; Max: 64.14 KB (65683) ; Number of samples: 657) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 3) - ParquetUncompressedBytesReadPerColumn: (Avg: 13.47 MB (14126889) ; Min: 419.06 KB (429113) ; Max: 36.51 MB (38284947) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 62.99 KB (64506) ; Min: 6.47 KB (6625) ; Max: 64.14 KB (65675) ; Number of samples: 657) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 23.03 MB (24152709) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 23.03 MB (24152709) - DataCacheHitCount: 15 (15) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 71.999ms - MaterializeTupleTime(*): 175.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 657 (657) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 42.62 MB (44686693) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 157.35 MB (164991722) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 10.66 MB (11178377) - RowBatchQueuePutWaitTime: 6s055ms - RowBatchesEnqueued: 1.35K (1349) - RowsRead: 4.88M (4875000) - RowsReturned: 1.38M (1375361) - RowsReturnedRate: 85.96 M/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 6s343ms - ScannerThreadsSysTime: 23.910ms - ScannerThreadsUserTime: 256.793ms - ScannerThreadsVoluntaryContextSwitches: 1.31K (1311) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 11.52 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 30.75 MB (32243712) - CumulativeAllocations: 12 (12) - PeakReservation: 30.38 MB (31850496) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 30.38 MB (31850496) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 107.999ms, non-child: 107.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 107.999ms - CodegenSysTime: 4.269ms - CodegenUserTime: 106.727ms - CodegenVoluntaryContextSwitches: 6 (6) - CompileTime: 19.999ms - IrGenerationTime: 3.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 55 (55) - NumInstructions: 1.40K (1400) - OptimizationTime: 71.999ms - PeakMemoryUsage: 700.00 KB (716800) - PrepareTime: 11.999ms Instance 2a45c19935b2f933:e73e987000000009 (host=impala-executor-000-5:22000):(Total: 2s064ms, non-child: 12.000ms, % non-child: 0.58%) Last report received time: 2019-11-21 23:02:35.843 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/60.03 MB Fragment Instance Lifecycle Event Timeline: 2s064ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 100.001ms (100.001ms) - First Batch Produced: 104.001ms (4.000ms) - First Batch Sent: 104.001ms (0.000ns) - ExecInternal Finished: 2s064ms (1s960ms) - MemoryUsage (500.000ms): 31.69 MB, 31.69 MB, 31.78 MB, 31.77 MB - ThreadUsage (500.000ms): 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 13.90 - PeakMemoryUsage: 31.87 MB (33417277) - PeakReservation: 20.25 MB (21233664) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782428291) - RowsProduced: 918.09K (918093) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s712ms - TotalStorageWaitTime: 8.000ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 5s844ms - TotalThreadsSysTime: 53.006ms - TotalThreadsUserTime: 467.189ms - TotalThreadsVoluntaryContextSwitches: 1.79K (1794) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s964ms - ExecTreeExecTime: 16.000ms - OpenTime: 100.001ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12):(Total: 1s936ms, non-child: 224.002ms, % non-child: 11.57%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.21 MB, 4.21 MB, 40.57 MB, 133.48 MB - NetworkThroughput: (Avg: 108.32 MB/sec ; Min: 5.83 MB/sec ; Max: 382.49 MB/sec ; Number of samples: 8980) - RpcNetworkTime: (Avg: 254.497us ; Min: -163548.000ns ; Max: 4.088ms ; Number of samples: 8990) - RpcRecvrTime: (Avg: 1.077ms ; Min: 13.645us ; Max: 861.018ms ; Number of samples: 8990) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 918.09K (918093) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 180.001ms - TotalBytesSent: 213.60 MB (223978330) - UncompressedRowBatchSize: 490.31 MB (514132080) HDFS_SCAN_NODE (id=4):(Total: 16.000ms, non-child: 16.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/60.03 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 2s064ms - Open Started: 100.001ms (100.001ms) - Open Finished: 100.001ms (0.000ns) - First Batch Requested: 100.001ms (0.000ns) - First Batch Returned: 104.001ms (4.000ms) - Last Batch Returned: 2s060ms (1s956ms) - Closed: 2s064ms (4.000ms) - BytesRead (500.000ms): 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 4.93 MB (5168422) ; Min: 181.45 KB (185805) ; Max: 12.28 MB (12872380) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.57 KB (35400) ; Min: 4.55 KB (4658) ; Max: 64.14 KB (65683) ; Number of samples: 438) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 8.99 MB (9427462) ; Min: 279.53 KB (286236) ; Max: 24.37 MB (25549298) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.06 KB (64571) ; Min: 6.63 KB (6790) ; Max: 64.14 KB (65675) ; Number of samples: 438) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 15.37 MB (16117718) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 15.37 MB (16117718) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 28.000ms - MaterializeTupleTime(*): 160.001ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 438 (438) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 31.72 MB (33265883) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 1.88 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 105.03 MB (110132258) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 10.42 MB (10925908) - RowBatchQueuePutWaitTime: 3s584ms - RowBatchesEnqueued: 902 (902) - RowsRead: 3.25M (3253250) - RowsReturned: 918.09K (918093) - RowsReturnedRate: 57.38 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 8.000ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 3s780ms - ScannerThreadsSysTime: 12.192ms - ScannerThreadsUserTime: 181.488ms - ScannerThreadsVoluntaryContextSwitches: 829 (829) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 8.000ms - TotalReadThroughput: 7.69 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 20.50 MB (21495808) - CumulativeAllocations: 8 (8) - PeakReservation: 20.25 MB (21233664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 20.25 MB (21233664) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 100.001ms, non-child: 100.001ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 100.001ms - CodegenSysTime: 3.974ms - CodegenUserTime: 95.399ms - CodegenVoluntaryContextSwitches: 6 (6) - CompileTime: 16.000ms - IrGenerationTime: 4.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 55 (55) - NumInstructions: 1.40K (1400) - OptimizationTime: 68.000ms - PeakMemoryUsage: 700.00 KB (716800) - PrepareTime: 12.000ms Instance 2a45c19935b2f933:e73e987000000003 (host=impala-executor-000-2:22000):(Total: 2s064ms, non-child: 16.000ms, % non-child: 0.78%) Last report received time: 2019-11-21 23:02:35.842 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.96 MB Fragment Instance Lifecycle Event Timeline: 2s064ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 100.000ms (100.000ms) - First Batch Produced: 108.000ms (8.000ms) - First Batch Sent: 108.000ms (0.000ns) - ExecInternal Finished: 2s064ms (1s956ms) - MemoryUsage (500.000ms): 31.69 MB, 31.69 MB, 31.70 MB, 31.69 MB - ThreadUsage (500.000ms): 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 13.92 - PeakMemoryUsage: 31.84 MB (33383961) - PeakReservation: 20.25 MB (21233664) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782691040) - RowsProduced: 919.05K (919048) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s752ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 5s832ms - TotalThreadsSysTime: 55.700ms - TotalThreadsUserTime: 471.684ms - TotalThreadsVoluntaryContextSwitches: 1.80K (1802) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s964ms - ExecTreeExecTime: 16.000ms - OpenTime: 100.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12):(Total: 1s936ms, non-child: 184.000ms, % non-child: 9.50%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 5.00 MB, 5.00 MB, 48.47 MB, 142.69 MB - NetworkThroughput: (Avg: 115.10 MB/sec ; Min: 7.47 MB/sec ; Max: 365.13 MB/sec ; Number of samples: 8980) - RpcNetworkTime: (Avg: 232.810us ; Min: -272481.000ns ; Max: 2.851ms ; Number of samples: 8990) - RpcRecvrTime: (Avg: 1.079ms ; Min: 13.316us ; Max: 856.450ms ; Number of samples: 8990) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 919.05K (919048) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 144.000ms - TotalBytesSent: 213.81 MB (224194000) - UncompressedRowBatchSize: 490.82 MB (514666880) HDFS_SCAN_NODE (id=4):(Total: 12.000ms, non-child: 12.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.96 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 2s064ms - Open Started: 100.000ms (100.000ms) - Open Finished: 100.000ms (0.000ns) - First Batch Requested: 100.000ms (0.000ns) - First Batch Returned: 108.000ms (8.000ms) - Last Batch Returned: 2s064ms (1s956ms) - Closed: 2s064ms (0.000ns) - BytesRead (500.000ms): 15.35 MB, 15.35 MB, 15.35 MB, 15.35 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 4.92 MB (5162627) ; Min: 180.79 KB (185127) ; Max: 12.26 MB (12858114) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.53 KB (35360) ; Min: 2.73 KB (2799) ; Max: 64.14 KB (65683) ; Number of samples: 438) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 8.98 MB (9418088) ; Min: 279.84 KB (286556) ; Max: 24.34 MB (25523298) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.00 KB (64507) ; Min: 5.43 KB (5559) ; Max: 64.14 KB (65675) ; Number of samples: 438) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 15.35 MB (16100206) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 15.35 MB (16100206) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 32.000ms - MaterializeTupleTime(*): 140.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 438 (438) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 31.66 MB (33198775) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.93 MB (110028760) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 10.36 MB (10858346) - RowBatchQueuePutWaitTime: 3s576ms - RowBatchesEnqueued: 902 (902) - RowsRead: 3.25M (3250000) - RowsReturned: 919.05K (919048) - RowsReturnedRate: 76.59 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 3s768ms - ScannerThreadsSysTime: 34.000ms - ScannerThreadsUserTime: 159.358ms - ScannerThreadsVoluntaryContextSwitches: 833 (833) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 7.68 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 20.50 MB (21495808) - CumulativeAllocations: 8 (8) - PeakReservation: 20.25 MB (21233664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 20.25 MB (21233664) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 100.000ms, non-child: 100.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 100.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 96.615ms - CodegenVoluntaryContextSwitches: 3 (3) - CompileTime: 16.000ms - IrGenerationTime: 4.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 55 (55) - NumInstructions: 1.40K (1400) - OptimizationTime: 64.000ms - PeakMemoryUsage: 700.00 KB (716800) - PrepareTime: 16.000ms Instance 2a45c19935b2f933:e73e987000000006 (host=impala-executor-000-6:22000):(Total: 2s063ms, non-child: 15.999ms, % non-child: 0.78%) Last report received time: 2019-11-21 23:02:35.839 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.85 MB Fragment Instance Lifecycle Event Timeline: 2s063ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 103.999ms (103.999ms) - First Batch Produced: 107.999ms (3.999ms) - First Batch Sent: 107.999ms (0.000ns) - ExecInternal Finished: 2s063ms (1s955ms) - MemoryUsage (500.000ms): 31.69 MB, 31.69 MB, 31.74 MB, 31.56 MB - ThreadUsage (500.000ms): 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 13.90 - PeakMemoryUsage: 31.84 MB (33384207) - PeakReservation: 20.25 MB (21233664) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782668702) - RowsProduced: 916.01K (916008) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s695ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 5s835ms - TotalThreadsSysTime: 71.108ms - TotalThreadsUserTime: 461.695ms - TotalThreadsVoluntaryContextSwitches: 1.80K (1796) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s959ms - ExecTreeExecTime: 15.999ms - OpenTime: 103.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12):(Total: 1s927ms, non-child: 231.998ms, % non-child: 12.03%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.55 MB, 4.55 MB, 65.10 MB, 161.83 MB - NetworkThroughput: (Avg: 108.43 MB/sec ; Min: 7.32 MB/sec ; Max: 340.81 MB/sec ; Number of samples: 8960) - RpcNetworkTime: (Avg: 246.518us ; Min: -64047.000ns ; Max: 3.258ms ; Number of samples: 8970) - RpcRecvrTime: (Avg: 989.876us ; Min: 12.375us ; Max: 860.784ms ; Number of samples: 8970) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 916.01K (916008) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 159.999ms - TotalBytesSent: 213.10 MB (223451950) - UncompressedRowBatchSize: 489.20 MB (512964480) HDFS_SCAN_NODE (id=4):(Total: 15.999ms, non-child: 15.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.85 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 2s063ms - Open Started: 103.999ms (103.999ms) - Open Finished: 103.999ms (0.000ns) - First Batch Requested: 103.999ms (0.000ns) - First Batch Returned: 107.999ms (3.999ms) - Last Batch Returned: 2s059ms (1s951ms) - Closed: 2s063ms (3.999ms) - BytesRead (500.000ms): 15.33 MB, 15.33 MB, 15.33 MB, 15.33 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 4.91 MB (5152642) ; Min: 180.62 KB (184954) ; Max: 12.24 MB (12833222) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.46 KB (35292) ; Min: 2.73 KB (2799) ; Max: 64.14 KB (65683) ; Number of samples: 438) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 8.96 MB (9398705) ; Min: 278.61 KB (285295) ; Max: 24.29 MB (25471298) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 62.87 KB (64374) ; Min: 5.43 KB (5559) ; Max: 64.14 KB (65675) ; Number of samples: 438) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 15.33 MB (16070185) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 15.33 MB (16070185) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 43.999ms - MaterializeTupleTime(*): 151.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 438 (438) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 31.67 MB (33207213) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.70 MB (109786065) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 10.36 MB (10858537) - RowBatchQueuePutWaitTime: 3s559ms - RowBatchesEnqueued: 899 (899) - RowsRead: 3.24M (3243500) - RowsReturned: 916.01K (916008) - RowsReturnedRate: 57.25 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 3s771ms - ScannerThreadsSysTime: 19.613ms - ScannerThreadsUserTime: 171.116ms - ScannerThreadsVoluntaryContextSwitches: 817 (817) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 7.66 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 20.50 MB (21495808) - CumulativeAllocations: 8 (8) - PeakReservation: 20.25 MB (21233664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 20.25 MB (21233664) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 103.999ms, non-child: 103.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 103.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 102.909ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 19.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 55 (55) - NumInstructions: 1.40K (1400) - OptimizationTime: 67.999ms - PeakMemoryUsage: 700.00 KB (716800) - PrepareTime: 15.999ms Instance 2a45c19935b2f933:e73e987000000008 (host=impala-executor-000-3:22000):(Total: 2s059ms, non-child: 3.999ms, % non-child: 0.19%) Last report received time: 2019-11-21 23:02:35.838 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.97 MB Fragment Instance Lifecycle Event Timeline: 2s059ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 99.999ms (99.999ms) - First Batch Produced: 103.999ms (3.999ms) - First Batch Sent: 103.999ms (0.000ns) - ExecInternal Finished: 2s059ms (1s955ms) - MemoryUsage (500.000ms): 26.43 MB, 31.75 MB, 31.75 MB, 31.78 MB - ThreadUsage (500.000ms): 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 13.90 - PeakMemoryUsage: 31.87 MB (33418562) - PeakReservation: 20.25 MB (21233664) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1783537850) - RowsProduced: 917.32K (917316) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s727ms - TotalStorageWaitTime: 7.999ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 5s819ms - TotalThreadsSysTime: 48.155ms - TotalThreadsUserTime: 462.190ms - TotalThreadsVoluntaryContextSwitches: 1.79K (1793) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s959ms - ExecTreeExecTime: 15.999ms - OpenTime: 99.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12):(Total: 1s939ms, non-child: 211.999ms, % non-child: 10.93%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 3.74 MB, 6.36 MB, 29.33 MB, 118.41 MB - NetworkThroughput: (Avg: 109.49 MB/sec ; Min: 13.97 MB/sec ; Max: 352.39 MB/sec ; Number of samples: 8970) - RpcNetworkTime: (Avg: 247.122us ; Min: -288473.000ns ; Max: 1.701ms ; Number of samples: 8980) - RpcRecvrTime: (Avg: 532.814us ; Min: 15.407us ; Max: 860.892ms ; Number of samples: 8980) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 917.32K (917316) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 143.999ms - TotalBytesSent: 213.43 MB (223794780) - UncompressedRowBatchSize: 489.90 MB (513696960) HDFS_SCAN_NODE (id=4):(Total: 15.999ms, non-child: 15.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/59.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 2s059ms - Open Started: 99.999ms (99.999ms) - Open Finished: 99.999ms (0.000ns) - First Batch Requested: 99.999ms (0.000ns) - First Batch Returned: 103.999ms (3.999ms) - Last Batch Returned: 2s059ms (1s955ms) - Closed: 2s059ms (0.000ns) - BytesRead (500.000ms): 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 4.92 MB (5163524) ; Min: 181.81 KB (186170) ; Max: 12.26 MB (12859770) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.54 KB (35366) ; Min: 4.47 KB (4580) ; Max: 64.14 KB (65683) ; Number of samples: 438) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 8.98 MB (9418190) ; Min: 280.14 KB (286866) ; Max: 24.34 MB (25523298) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.00 KB (64508) ; Min: 6.49 KB (6644) ; Max: 64.14 KB (65675) ; Number of samples: 438) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 15.36 MB (16102970) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 15.36 MB (16102970) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 51.999ms - MaterializeTupleTime(*): 123.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 438 (438) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 31.69 MB (33233376) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 1.87 GB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.90 MB (109995272) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 10.39 MB (10892543) - RowBatchQueuePutWaitTime: 3s567ms - RowBatchesEnqueued: 900 (900) - RowsRead: 3.25M (3250000) - RowsReturned: 917.32K (917316) - RowsReturnedRate: 57.33 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 7.999ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 3s759ms - ScannerThreadsSysTime: 9.126ms - ScannerThreadsUserTime: 181.180ms - ScannerThreadsVoluntaryContextSwitches: 825 (825) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 7.999ms - TotalReadThroughput: 7.68 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 20.50 MB (21495808) - CumulativeAllocations: 8 (8) - PeakReservation: 20.25 MB (21233664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 20.25 MB (21233664) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 99.999ms, non-child: 99.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 99.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 97.641ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 15.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 55 (55) - NumInstructions: 1.40K (1400) - OptimizationTime: 67.999ms - PeakMemoryUsage: 700.00 KB (716800) - PrepareTime: 15.999ms Instance 2a45c19935b2f933:e73e987000000007 (host=impala-executor-000-1:22000):(Total: 2s020ms, non-child: 16.000ms, % non-child: 0.79%) Last report received time: 2019-11-21 23:02:35.840 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/60.03 MB Fragment Instance Lifecycle Event Timeline: 2s020ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 104.000ms (104.000ms) - First Batch Produced: 108.000ms (4.000ms) - First Batch Sent: 108.000ms (0.000ns) - ExecInternal Finished: 2s020ms (1s912ms) - MemoryUsage (500.000ms): 31.72 MB, 31.72 MB, 31.77 MB, 31.72 MB - ThreadUsage (500.000ms): 3, 3, 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 13.90 - PeakMemoryUsage: 31.87 MB (33417838) - PeakReservation: 20.25 MB (21233664) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782498619) - RowsProduced: 918.38K (918382) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s728ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 5s688ms - TotalThreadsSysTime: 60.991ms - TotalThreadsUserTime: 455.971ms - TotalThreadsVoluntaryContextSwitches: 1.80K (1797) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s916ms - ExecTreeExecTime: 12.000ms - OpenTime: 104.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12):(Total: 1s892ms, non-child: 164.000ms, % non-child: 8.67%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 5.00 MB, 5.00 MB, 65.69 MB, 168.14 MB - NetworkThroughput: (Avg: 105.07 MB/sec ; Min: 288.29 KB/sec ; Max: 348.37 MB/sec ; Number of samples: 8980) - RpcNetworkTime: (Avg: 261.937us ; Min: -803599.000ns ; Max: 3.432ms ; Number of samples: 8990) - RpcRecvrTime: (Avg: 1.084ms ; Min: 13.505us ; Max: 860.937ms ; Number of samples: 8990) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 918.38K (918382) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 124.000ms - TotalBytesSent: 213.63 MB (224003090) - UncompressedRowBatchSize: 490.47 MB (514293920) HDFS_SCAN_NODE (id=4):(Total: 8.000ms, non-child: 8.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/60.03 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 2s020ms - Open Started: 104.000ms (104.000ms) - Open Finished: 104.000ms (0.000ns) - First Batch Requested: 104.000ms (0.000ns) - First Batch Returned: 108.000ms (4.000ms) - Last Batch Returned: 2s016ms (1s908ms) - Closed: 2s020ms (4.000ms) - BytesRead (500.000ms): 15.37 MB, 15.37 MB, 15.37 MB, 15.37 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - ParquetCompressedBytesReadPerColumn: (Avg: 4.93 MB (5167971) ; Min: 181.33 KB (185683) ; Max: 12.27 MB (12871150) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.57 KB (35397) ; Min: 4.67 KB (4787) ; Max: 64.14 KB (65683) ; Number of samples: 438) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 8.99 MB (9427658) ; Min: 280.10 KB (286824) ; Max: 24.37 MB (25549298) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.06 KB (64573) ; Min: 6.69 KB (6847) ; Max: 64.14 KB (65675) ; Number of samples: 438) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 15.37 MB (16116354) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 15.37 MB (16116354) - DataCacheHitCount: 10 (10) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 40.000ms - MaterializeTupleTime(*): 132.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 438 (438) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 31.69 MB (33232652) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 105.03 MB (110132846) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 10.39 MB (10891967) - RowBatchQueuePutWaitTime: 3s488ms - RowBatchesEnqueued: 901 (901) - RowsRead: 3.25M (3253250) - RowsReturned: 918.38K (918382) - RowsReturnedRate: 114.80 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 3s668ms - ScannerThreadsSysTime: 20.499ms - ScannerThreadsUserTime: 168.022ms - ScannerThreadsVoluntaryContextSwitches: 817 (817) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 7.68 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 20.50 MB (21495808) - CumulativeAllocations: 8 (8) - PeakReservation: 20.25 MB (21233664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 20.25 MB (21233664) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 104.000ms, non-child: 104.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 104.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 101.919ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 20.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 55 (55) - NumInstructions: 1.40K (1400) - OptimizationTime: 68.000ms - PeakMemoryUsage: 700.00 KB (716800) - PrepareTime: 16.000ms Instance 2a45c19935b2f933:e73e987000000001 (host=impala-executor-000-4:22000):(Total: 1s556ms, non-child: 12.000ms, % non-child: 0.77%) Last report received time: 2019-11-21 23:02:35.841 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/29.99 MB Fragment Instance Lifecycle Event Timeline: 1s556ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 100.000ms (100.000ms) - First Batch Produced: 104.000ms (4.000ms) - First Batch Sent: 104.000ms (0.000ns) - ExecInternal Finished: 1s556ms (1s452ms) - MemoryUsage (500.000ms): 13.06 MB, 20.90 MB, 20.91 MB - ThreadUsage (500.000ms): 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 13.89 - PeakMemoryUsage: 21.01 MB (22027344) - PeakReservation: 10.12 MB (10616832) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1781816433) - RowsProduced: 458.37K (458365) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s368ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 2s908ms - TotalThreadsSysTime: 31.614ms - TotalThreadsUserTime: 271.510ms - TotalThreadsVoluntaryContextSwitches: 883 (883) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s456ms - ExecTreeExecTime: 4.000ms - OpenTime: 100.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=12):(Total: 1s440ms, non-child: 72.000ms, % non-child: 5.00%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 3.86 MB, 5.88 MB, 28.87 MB - NetworkThroughput: (Avg: 106.20 MB/sec ; Min: 10.01 MB/sec ; Max: 380.54 MB/sec ; Number of samples: 4480) - RpcNetworkTime: (Avg: 256.711us ; Min: -758413.000ns ; Max: 2.380ms ; Number of samples: 4490) - RpcRecvrTime: (Avg: 1.827ms ; Min: 14.181us ; Max: 860.586ms ; Number of samples: 4490) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 458.37K (458365) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 56.000ms - TotalBytesSent: 106.64 MB (111820330) - UncompressedRowBatchSize: 244.79 MB (256684400) HDFS_SCAN_NODE (id=4):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/29.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 1s556ms - Open Started: 100.000ms (100.000ms) - Open Finished: 100.000ms (0.000ns) - First Batch Requested: 100.000ms (0.000ns) - First Batch Returned: 104.000ms (4.000ms) - Last Batch Returned: 1s552ms (1s448ms) - Closed: 1s556ms (4.000ms) - BytesRead (500.000ms): 7.68 MB, 7.68 MB, 7.68 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 8.00 MB (8388608) ; Min: 8.00 MB (8388608) ; Max: 8.00 MB (8388608) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - ParquetCompressedBytesReadPerColumn: (Avg: 2.46 MB (2581822) ; Min: 91.30 KB (93490) ; Max: 6.13 MB (6429659) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 34.54 KB (35367) ; Min: 4.64 KB (4751) ; Max: 64.14 KB (65683) ; Number of samples: 219) - ParquetRowGroupActualReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 10.12 MB (10616832) ; Min: 10.12 MB (10616832) ; Max: 10.12 MB (10616832) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 4.49 MB (4709205) ; Min: 140.39 KB (143764) ; Max: 12.17 MB (12761649) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 63.00 KB (64509) ; Min: 6.69 KB (6855) ; Max: 64.14 KB (65675) ; Number of samples: 219) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 7.68 MB (8051666) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 5 (5) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 7.68 MB (8051666) - DataCacheHitCount: 5 (5) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.000ms - MaterializeTupleTime(*): 52.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 219 (219) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 20.86 MB (21875950) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 52.45 MB (54997967) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 10.24 MB (10737029) - RowBatchQueuePutWaitTime: 1s288ms - RowBatchesEnqueued: 450 (450) - RowsRead: 1.62M (1625000) - RowsReturned: 458.37K (458365) - RowsReturnedRate: 114.59 M/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 1s352ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 91.075ms - ScannerThreadsVoluntaryContextSwitches: 350 (350) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 5.12 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 10.25 MB (10747904) - CumulativeAllocations: 4 (4) - PeakReservation: 10.12 MB (10616832) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 10.12 MB (10616832) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 100.000ms, non-child: 100.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 100.000ms - CodegenSysTime: 3.954ms - CodegenUserTime: 94.677ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 20.000ms - IrGenerationTime: 4.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 55 (55) - NumInstructions: 1.40K (1400) - OptimizationTime: 64.000ms - PeakMemoryUsage: 700.00 KB (716800) - PrepareTime: 12.000ms Averaged Fragment F02:(Total: 44.000ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:5s012ms max:5s012ms mean: 5s012ms stddev:0.000ns execution rates: min:440.22 KB/sec max:440.22 KB/sec mean:440.22 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.06 - PeakMemoryUsage: 1.74 MB (1819312) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782691040) - RowsProduced: 365 (365) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 48.000ms - TotalThreadsSysTime: 4.091ms - TotalThreadsUserTime: 33.150ms - TotalThreadsVoluntaryContextSwitches: 29 (29) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8.000ms - ExecTreeExecTime: 4.000ms - OpenTime: 36.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=13):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) - EosSent: 10 (10) - PeakMemoryUsage: 98.44 KB (100800) - RowsSent: 365 (365) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 28.70 KB (29390) - UncompressedRowBatchSize: 74.85 KB (76650) HDFS_SCAN_NODE (id=5):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 466.80 KB (478002) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 466.80 KB (478002) - DataCacheHitCount: 4 (4) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 9 (9) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 2 (2) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.63 MB (1709860) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 26.00 KB (26624) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 42.00 KB (43008) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 65.10K (65100) - RowsReturned: 365 (365) - RowsReturnedRate: 91.25 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.000ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 410.000us - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 648.00 KB (663552) - CumulativeAllocations: 3 (3) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 520.00 KB (532480) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 36.000ms, non-child: 36.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 36.000ms - CodegenSysTime: 4.027ms - CodegenUserTime: 32.220ms - CodegenVoluntaryContextSwitches: 10 (10) - CompileTime: 8.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 18 (18) - NumInstructions: 344 (344) - OptimizationTime: 12.000ms - PeakMemoryUsage: 172.00 KB (176128) - PrepareTime: 16.000ms Fragment F02: Instance 2a45c19935b2f933:e73e98700000000a (host=impala-executor-000-2:22000):(Total: 44.000ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.842 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.15 MB Fragment Instance Lifecycle Event Timeline: 44.000ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 36.000ms (36.000ms) - First Batch Produced: 40.000ms (4.000ms) - First Batch Sent: 40.000ms (0.000ns) - ExecInternal Finished: 44.000ms (4.000ms) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.06 - PeakMemoryUsage: 1.74 MB (1819312) - PeakReservation: 1.00 MB (1048576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782691040) - RowsProduced: 365 (365) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.000ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 48.000ms - TotalThreadsSysTime: 4.091ms - TotalThreadsUserTime: 33.150ms - TotalThreadsVoluntaryContextSwitches: 29 (29) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8.000ms - ExecTreeExecTime: 4.000ms - OpenTime: 36.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=13):(Total: 4.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - NetworkThroughput: (Avg: 14.72 MB/sec ; Min: 9.91 MB/sec ; Max: 31.58 MB/sec ; Number of samples: 10) - RpcNetworkTime: (Avg: 176.868us ; Min: 53.281us ; Max: 282.816us ; Number of samples: 20) - RpcRecvrTime: (Avg: 25.630us ; Min: 14.800us ; Max: 46.174us ; Number of samples: 20) - EosSent: 10 (10) - PeakMemoryUsage: 98.44 KB (100800) - RowsSent: 365 (365) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 28.70 KB (29390) - UncompressedRowBatchSize: 74.85 KB (76650) HDFS_SCAN_NODE (id=5):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 44.000ms - Open Started: 36.000ms (36.000ms) - Open Finished: 36.000ms (0.000ns) - First Batch Requested: 36.000ms (0.000ns) - First Batch Returned: 40.000ms (4.000ms) - Last Batch Returned: 40.000ms (0.000ns) - Closed: 44.000ms (4.000ms) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - ParquetCompressedBytesReadPerColumn: (Avg: 103.45 KB (105934) ; Min: 551.00 B (551) ; Max: 206.37 KB (211318) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 29.56 KB (30267) ; Min: 551.00 B (551) ; Max: 64.14 KB (65683) ; Number of samples: 7) - ParquetRowGroupActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 520.00 KB (532480) ; Min: 520.00 KB (532480) ; Max: 520.00 KB (532480) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 167.39 KB (171410) ; Min: 546.00 B (546) ; Max: 334.25 KB (342274) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 47.83 KB (48974) ; Min: 546.00 B (546) ; Max: 64.14 KB (65675) ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 466.80 KB (478002) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 466.80 KB (478002) - DataCacheHitCount: 4 (4) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 9 (9) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 2 (2) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.63 MB (1709860) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 26.00 KB (26624) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 42.00 KB (43008) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 65.10K (65100) - RowsReturned: 365 (365) - RowsReturnedRate: 91.25 K/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 4.000ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 410.000us - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 648.00 KB (663552) - CumulativeAllocations: 3 (3) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 520.00 KB (532480) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 36.000ms, non-child: 36.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 36.000ms - CodegenSysTime: 4.027ms - CodegenUserTime: 32.220ms - CodegenVoluntaryContextSwitches: 10 (10) - CompileTime: 8.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 18 (18) - NumInstructions: 344 (344) - OptimizationTime: 12.000ms - PeakMemoryUsage: 172.00 KB (176128) - PrepareTime: 16.000ms Averaged Fragment F03:(Total: 1s166ms, non-child: 1.200ms, % non-child: 0.10%) split sizes: min: 470.66 KB, max: 1.38 MB, avg: 942.65 KB, stddev: 210.85 KB completion times: min:5s008ms max:5s012ms mean: 5s010ms stddev:1.833ms execution rates: min:93.98 KB/sec max:282.04 KB/sec mean:188.12 KB/sec stddev:42.05 KB/sec num instances: 10 - AverageThreadTokens: 2.77 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.37 - PeakMemoryUsage: 5.27 MB (5528387) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1781754861) - RowsProduced: 192.08K (192080) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s102ms - TotalStorageWaitTime: 399.997us - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 3s204ms - TotalThreadsSysTime: 17.282ms - TotalThreadsUserTime: 66.410ms - TotalThreadsVoluntaryContextSwitches: 405 (405) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s142ms - ExecTreeExecTime: 6.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s134ms, non-child: 1s134ms, % non-child: 100.00%) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.08K (192080) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 22.400ms - TotalBytesSent: 43.22 MB (45319091) - UncompressedRowBatchSize: 94.47 MB (99058400) HDFS_SCAN_NODE (id=2):(Total: 6.000ms, non-child: 6.000ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.77 - BytesRead: 1.10 MB (1151047) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151047) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 2.799ms - MaterializeTupleTime(*): 2.400ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.21 MB (5460774) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 54.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6478620) - RowBatchQueueGetWaitTime: 3.600ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3502513) - RowBatchQueuePutWaitTime: 2s026ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.08K (192080) - RowsReturned: 192.08K (192080) - RowsReturnedRate: 36.02 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 399.997us - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s038ms - ScannerThreadsSysTime: 5.070ms - ScannerThreadsUserTime: 7.448ms - ScannerThreadsVoluntaryContextSwitches: 127 (127) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 799.998us - TotalReadThroughput: 993.01 KB/sec Buffer pool: - AllocTime: 400.001us - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 400.001us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 1.495ms - CodegenUserTime: 21.205ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 5.600ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 14.000ms Fragment F03: Instance 2a45c19935b2f933:e73e98700000000d (host=impala-executor-000-7:22000):(Total: 1s211ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.836 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/1.38 MB Fragment Instance Lifecycle Event Timeline: 1s211ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 23.999ms (23.999ms) - First Batch Produced: 27.999ms (3.999ms) - First Batch Sent: 27.999ms (0.000ns) - ExecInternal Finished: 1s211ms (1s183ms) - MemoryUsage (500.000ms): 6.16 MB, 6.16 MB, 6.26 MB - ThreadUsage (500.000ms): 4, 4, 4 - AverageThreadTokens: 4.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.36 - PeakMemoryUsage: 6.27 MB (6574116) - PeakReservation: 1.55 MB (1622016) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1777874705) - RowsProduced: 287.93K (287927) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s107ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 4s679ms - TotalThreadsSysTime: 38.358ms - TotalThreadsUserTime: 75.119ms - TotalThreadsVoluntaryContextSwitches: 732 (732) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s187ms - ExecTreeExecTime: 11.999ms - OpenTime: 23.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s175ms, non-child: 67.999ms, % non-child: 5.78%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 5.25 MB, 5.25 MB, 24.67 MB - NetworkThroughput: (Avg: 97.96 MB/sec ; Min: 7.56 MB/sec ; Max: 345.36 MB/sec ; Number of samples: 2820) - RpcNetworkTime: (Avg: 271.226us ; Min: 25.496us ; Max: 3.043ms ; Number of samples: 2830) - RpcRecvrTime: (Avg: 3.307ms ; Min: 18.560us ; Max: 938.133ms ; Number of samples: 2830) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 287.93K (287927) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 39.999ms - TotalBytesSent: 64.78 MB (67924340) - UncompressedRowBatchSize: 141.62 MB (148499690) HDFS_SCAN_NODE (id=2):(Total: 11.999ms, non-child: 11.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/1.38 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:3 Node Lifecycle Event Timeline: 1s211ms - Open Started: 23.999ms (23.999ms) - Open Finished: 23.999ms (0.000ns) - First Batch Requested: 23.999ms (0.000ns) - First Batch Returned: 27.999ms (3.999ms) - Last Batch Returned: 1s211ms (1s183ms) - Closed: 1s211ms (0.000ns) - BytesRead (500.000ms): 1.65 MB, 1.65 MB, 1.65 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 3) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 304.54 KB (311849) ; Min: 9.14 KB (9362) ; Max: 893.55 KB (914997) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.68 KB (28349) ; Min: 2.96 KB (3027) ; Max: 64.14 KB (65683) ; Number of samples: 33) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 3) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 3) - ParquetUncompressedBytesReadPerColumn: (Avg: 571.28 KB (584986) ; Min: 61.05 KB (62511) ; Max: 1.51 MB (1583875) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.93 KB (53180) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 33) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 1.65 MB (1725851) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 12 (12) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.65 MB (1725851) - DataCacheHitCount: 12 (12) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 7.999ms - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 33 (33) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.22 MB (6525972) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 9.26 MB (9712716) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 3.40 MB (3569134) - RowBatchQueuePutWaitTime: 3s447ms - RowBatchesEnqueued: 288 (288) - RowsRead: 287.93K (287927) - RowsReturned: 287.93K (287927) - RowsReturnedRate: 23.99 M/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 3s467ms - ScannerThreadsSysTime: 9.071ms - ScannerThreadsUserTime: 9.224ms - ScannerThreadsVoluntaryContextSwitches: 242 (242) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.92 MB (2015232) - CumulativeAllocations: 12 (12) - PeakReservation: 1.55 MB (1622016) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.55 MB (1622016) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 23.999ms, non-child: 23.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 23.999ms - CodegenSysTime: 3.959ms - CodegenUserTime: 19.799ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 3.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 7.999ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 11.999ms Instance 2a45c19935b2f933:e73e987000000012 (host=impala-executor-000-2:22000):(Total: 1s180ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.842 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.50 KB Fragment Instance Lifecycle Event Timeline: 1s180ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 28.000ms (28.000ms) - First Batch Produced: 28.000ms (0.000ns) - First Batch Sent: 32.000ms (4.000ms) - ExecInternal Finished: 1s180ms (1s148ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.38 - PeakMemoryUsage: 5.27 MB (5524228) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782691040) - RowsProduced: 192.08K (192078) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s120ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 3s304ms - TotalThreadsSysTime: 19.217ms - TotalThreadsUserTime: 65.922ms - TotalThreadsVoluntaryContextSwitches: 384 (384) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s152ms - ExecTreeExecTime: 8.000ms - OpenTime: 28.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s144ms, non-child: 24.000ms, % non-child: 2.10%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 3.25 MB, 3.25 MB - NetworkThroughput: (Avg: 98.91 MB/sec ; Min: 9.91 MB/sec ; Max: 345.27 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 264.738us ; Min: 2.389us ; Max: 2.325ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 4.441ms ; Min: 13.487us ; Max: 937.598ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.08K (192078) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 20.000ms - TotalBytesSent: 43.23 MB (45326060) - UncompressedRowBatchSize: 94.46 MB (99050700) HDFS_SCAN_NODE (id=2):(Total: 8.000ms, non-child: 8.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.50 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s180ms - Open Started: 28.000ms (28.000ms) - Open Finished: 28.000ms (0.000ns) - First Batch Requested: 28.000ms (0.000ns) - First Batch Returned: 28.000ms (0.000ns) - Last Batch Returned: 1s176ms (1s148ms) - Closed: 1s180ms (4.000ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.18 KB (208061) ; Min: 6.08 KB (6231) ; Max: 596.25 KB (610555) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.71 KB (28372) ; Min: 3.03 KB (3098) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.20 KB (390348) ; Min: 40.71 KB (41686) ; Max: 1.01 MB (1056930) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.98 KB (53229) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1151067) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151067) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - MaterializeTupleTime(*): 4.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.19 MB (5442292) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475204) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePeakMemoryUsage: 3.34 MB (3499804) - RowBatchQueuePutWaitTime: 2s116ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.08K (192078) - RowsReturned: 192.08K (192078) - RowsReturnedRate: 24.01 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 2s124ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 13.075ms - ScannerThreadsVoluntaryContextSwitches: 132 (132) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 28.000ms, non-child: 28.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 28.000ms - CodegenSysTime: 3.507ms - CodegenUserTime: 21.042ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 8.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms Instance 2a45c19935b2f933:e73e987000000014 (host=impala-executor-000-5:22000):(Total: 1s176ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.843 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.84 KB Fragment Instance Lifecycle Event Timeline: 1s176ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 28.000ms (4.000ms) - First Batch Sent: 28.000ms (0.000ns) - ExecInternal Finished: 1s176ms (1s148ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.38 - PeakMemoryUsage: 5.27 MB (5524197) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782428291) - RowsProduced: 192.08K (192083) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s136ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3s308ms - TotalThreadsSysTime: 13.694ms - TotalThreadsUserTime: 69.235ms - TotalThreadsVoluntaryContextSwitches: 396 (396) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s152ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s148ms, non-child: 12.000ms, % non-child: 1.05%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 3.59 MB, 3.59 MB - NetworkThroughput: (Avg: 92.24 MB/sec ; Min: 26.97 MB/sec ; Max: 353.01 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 284.481us ; Min: 44.052us ; Max: 854.114us ; Number of samples: 1890) - RpcRecvrTime: (Avg: 4.921ms ; Min: 14.714us ; Max: 937.828ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.08K (192083) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4.000ms - TotalBytesSent: 43.23 MB (45329680) - UncompressedRowBatchSize: 94.46 MB (99050110) HDFS_SCAN_NODE (id=2):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.84 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s176ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 28.000ms (4.000ms) - Last Batch Returned: 1s172ms (1s144ms) - Closed: 1s176ms (4.000ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.22 KB (208098) ; Min: 6.09 KB (6234) ; Max: 596.25 KB (610563) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.71 KB (28377) ; Min: 3.00 KB (3069) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.20 KB (390351) ; Min: 40.67 KB (41649) ; Max: 1.01 MB (1056970) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.98 KB (53229) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1151140) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151140) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.19 MB (5442261) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475173) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3499833) - RowBatchQueuePutWaitTime: 2s124ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.08K (192083) - RowsReturned: 192.08K (192083) - RowsReturnedRate: 48.02 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s132ms - ScannerThreadsSysTime: 13.694ms - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 129 (129) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 24.696ms - CodegenVoluntaryContextSwitches: 7 (7) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 8.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 12.000ms Instance 2a45c19935b2f933:e73e98700000000c (host=impala-executor-000-1:22000):(Total: 1s176ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.840 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/943.35 KB Fragment Instance Lifecycle Event Timeline: 1s176ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 28.000ms (4.000ms) - First Batch Sent: 28.000ms (0.000ns) - ExecInternal Finished: 1s176ms (1s148ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.38 - PeakMemoryUsage: 5.27 MB (5524537) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782498619) - RowsProduced: 192.27K (192272) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s100ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 3s276ms - TotalThreadsSysTime: 8.076ms - TotalThreadsUserTime: 75.798ms - TotalThreadsVoluntaryContextSwitches: 394 (394) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s152ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s148ms, non-child: 48.000ms, % non-child: 4.18%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.88 MB, 4.88 MB - NetworkThroughput: (Avg: 92.11 MB/sec ; Min: 14.12 MB/sec ; Max: 297.27 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 285.045us ; Min: -51287.000ns ; Max: 1.630ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 4.446ms ; Min: 15.407us ; Max: 937.682ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.27K (192272) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 40.000ms - TotalBytesSent: 43.25 MB (45353210) - UncompressedRowBatchSize: 94.57 MB (99164080) HDFS_SCAN_NODE (id=2):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/943.35 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s176ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 28.000ms (4.000ms) - Last Batch Returned: 1s172ms (1s144ms) - Closed: 1s176ms (4.000ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.42 KB (208301) ; Min: 6.10 KB (6244) ; Max: 596.96 KB (611289) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.74 KB (28404) ; Min: 3.01 KB (3085) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.76 KB (390925) ; Min: 40.81 KB (41792) ; Max: 1.01 MB (1058482) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 52.06 KB (53308) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1151786) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151786) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.19 MB (5442601) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475382) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3499787) - RowBatchQueuePutWaitTime: 2s084ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.27K (192272) - RowsReturned: 192.27K (192272) - RowsReturnedRate: 48.07 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s100ms - ScannerThreadsSysTime: 4.308ms - ScannerThreadsUserTime: 8.018ms - ScannerThreadsVoluntaryContextSwitches: 122 (122) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 4.000ms - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.000ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 21.785ms - CodegenVoluntaryContextSwitches: 3 (3) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms Instance 2a45c19935b2f933:e73e98700000000b (host=impala-executor-000-6:22000):(Total: 1s175ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.838 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/943.33 KB Fragment Instance Lifecycle Event Timeline: 1s175ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 23.999ms (23.999ms) - First Batch Produced: 27.999ms (3.999ms) - First Batch Sent: 27.999ms (0.000ns) - ExecInternal Finished: 1s175ms (1s147ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.40 - PeakMemoryUsage: 5.28 MB (5532608) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782668702) - RowsProduced: 192.27K (192274) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s099ms - TotalStorageWaitTime: 3.999ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 3s303ms - TotalThreadsSysTime: 15.680ms - TotalThreadsUserTime: 70.681ms - TotalThreadsVoluntaryContextSwitches: 389 (389) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s151ms - ExecTreeExecTime: 7.999ms - OpenTime: 23.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s143ms, non-child: 43.999ms, % non-child: 3.85%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.54 MB, 4.54 MB - NetworkThroughput: (Avg: 96.06 MB/sec ; Min: 31.78 MB/sec ; Max: 303.46 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 270.106us ; Min: -116432.000ns ; Max: 724.257us ; Number of samples: 1890) - RpcRecvrTime: (Avg: 4.442ms ; Min: 14.131us ; Max: 938.266ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.27K (192274) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 31.999ms - TotalBytesSent: 43.28 MB (45379990) - UncompressedRowBatchSize: 94.58 MB (99172680) HDFS_SCAN_NODE (id=2):(Total: 7.999ms, non-child: 7.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/943.33 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s175ms - Open Started: 23.999ms (23.999ms) - Open Finished: 23.999ms (0.000ns) - First Batch Requested: 23.999ms (0.000ns) - First Batch Returned: 27.999ms (3.999ms) - Last Batch Returned: 1s171ms (1s143ms) - Closed: 1s175ms (3.999ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 3.999ms ; Min: 3.999ms ; Max: 3.999ms ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.45 KB (208337) ; Min: 6.08 KB (6223) ; Max: 596.96 KB (611284) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.74 KB (28409) ; Min: 3.01 KB (3084) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.77 KB (390934) ; Min: 40.82 KB (41796) ; Max: 1.01 MB (1058498) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 52.06 KB (53309) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1151871) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151871) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 3.999ms - MaterializeTupleTime(*): 3.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.20 MB (5450672) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 274.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475392) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3499751) - RowBatchQueuePutWaitTime: 2s111ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.27K (192274) - RowsReturned: 192.27K (192274) - RowsReturnedRate: 24.03 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 3.999ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s127ms - ScannerThreadsSysTime: 3.490ms - ScannerThreadsUserTime: 9.945ms - ScannerThreadsVoluntaryContextSwitches: 126 (126) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 3.999ms - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 23.999ms, non-child: 23.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 23.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 22.612ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 3.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 3.999ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 15.999ms Instance 2a45c19935b2f933:e73e98700000000f (host=impala-executor-000-4:22000):(Total: 1s172ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.841 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.47 KB Fragment Instance Lifecycle Event Timeline: 1s172ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 28.000ms (4.000ms) - First Batch Sent: 28.000ms (0.000ns) - ExecInternal Finished: 1s172ms (1s144ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB, 3.01 MB - ThreadUsage (500.000ms): 3, 3, 1 - AverageThreadTokens: 2.33 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.37 - PeakMemoryUsage: 5.28 MB (5532476) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1781816433) - RowsProduced: 192.08K (192079) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s116ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 3s284ms - TotalThreadsSysTime: 17.788ms - TotalThreadsUserTime: 65.146ms - TotalThreadsVoluntaryContextSwitches: 389 (389) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s148ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s144ms, non-child: 28.000ms, % non-child: 2.45%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.17 MB, 4.17 MB, 29.93 MB - NetworkThroughput: (Avg: 89.70 MB/sec ; Min: 8.08 MB/sec ; Max: 362.15 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 290.960us ; Min: -128486.000ns ; Max: 2.849ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 4.452ms ; Min: 13.908us ; Max: 935.537ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.08K (192079) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 24.000ms - TotalBytesSent: 43.22 MB (45318520) - UncompressedRowBatchSize: 94.46 MB (99043950) HDFS_SCAN_NODE (id=2):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.47 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s172ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 28.000ms (4.000ms) - Last Batch Returned: 1s172ms (1s144ms) - Closed: 1s172ms (0.000ns) - BytesRead (500.000ms): 1.10 MB, 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.17 KB (208041) ; Min: 6.09 KB (6237) ; Max: 596.25 KB (610559) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.70 KB (28369) ; Min: 3.04 KB (3118) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.22 KB (390370) ; Min: 40.76 KB (41742) ; Max: 1.01 MB (1056938) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.98 KB (53232) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.33 - BytesRead: 1.10 MB (1150959) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1150959) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 4.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484332) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475260) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3499832) - RowBatchQueuePutWaitTime: 2s104ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.08K (192079) - RowsReturned: 192.08K (192079) - RowsReturnedRate: 48.02 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s112ms - ScannerThreadsSysTime: 7.050ms - ScannerThreadsUserTime: 6.082ms - ScannerThreadsVoluntaryContextSwitches: 125 (125) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 749.32 KB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 3.798ms - CodegenUserTime: 18.992ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 12.000ms Instance 2a45c19935b2f933:e73e987000000011 (host=impala-executor-000-0:22000):(Total: 1s171ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.841 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.76 KB Fragment Instance Lifecycle Event Timeline: 1s171ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 23.999ms (23.999ms) - First Batch Produced: 27.999ms (3.999ms) - First Batch Sent: 27.999ms (0.000ns) - ExecInternal Finished: 1s171ms (1s143ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.38 - PeakMemoryUsage: 5.27 MB (5524418) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1778624685) - RowsProduced: 192.08K (192079) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s107ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 3s275ms - TotalThreadsSysTime: 15.702ms - TotalThreadsUserTime: 66.287ms - TotalThreadsVoluntaryContextSwitches: 397 (397) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s147ms - ExecTreeExecTime: 3.999ms - OpenTime: 23.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s143ms, non-child: 35.999ms, % non-child: 3.15%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.15 MB, 4.15 MB - NetworkThroughput: (Avg: 96.87 MB/sec ; Min: 11.63 MB/sec ; Max: 337.70 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 273.647us ; Min: -3587.000ns ; Max: 1.980ms ; Number of samples: 1890) - RpcRecvrTime: (Avg: 4.922ms ; Min: 13.280us ; Max: 938.035ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.08K (192079) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 27.999ms - TotalBytesSent: 43.23 MB (45327580) - UncompressedRowBatchSize: 94.47 MB (99063490) HDFS_SCAN_NODE (id=2):(Total: 3.999ms, non-child: 3.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/942.76 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s171ms - Open Started: 23.999ms (23.999ms) - Open Finished: 23.999ms (0.000ns) - First Batch Requested: 23.999ms (0.000ns) - First Batch Returned: 27.999ms (3.999ms) - Last Batch Returned: 1s171ms (1s143ms) - Closed: 1s171ms (0.000ns) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.19 KB (208070) ; Min: 6.25 KB (6396) ; Max: 596.21 KB (610514) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.71 KB (28373) ; Min: 3.11 KB (3180) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 381.22 KB (390371) ; Min: 40.77 KB (41745) ; Max: 1.01 MB (1056938) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.98 KB (53232) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1151072) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1151072) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 3.999ms - MaterializeTupleTime(*): 3.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.20 MB (5450543) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475263) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3499643) - RowBatchQueuePutWaitTime: 2s091ms - RowBatchesEnqueued: 192 (192) - RowsRead: 192.08K (192079) - RowsReturned: 192.08K (192079) - RowsReturnedRate: 48.02 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s103ms - ScannerThreadsSysTime: 6.410ms - ScannerThreadsUserTime: 5.884ms - ScannerThreadsVoluntaryContextSwitches: 127 (127) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 23.999ms, non-child: 23.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 23.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 23.472ms - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 3.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 7.999ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 11.999ms Instance 2a45c19935b2f933:e73e987000000013 (host=impala-executor-000-8:22000):(Total: 1s168ms, non-child: 12.000ms, % non-child: 1.03%) Last report received time: 2019-11-21 23:02:35.837 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/940.83 KB Fragment Instance Lifecycle Event Timeline: 1s168ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 20.000ms (20.000ms) - First Batch Produced: 24.000ms (4.000ms) - First Batch Sent: 24.000ms (0.000ns) - ExecInternal Finished: 1s168ms (1s144ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB, 1.93 MB - ThreadUsage (500.000ms): 3, 3, 1 - AverageThreadTokens: 2.33 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.35 - PeakMemoryUsage: 5.28 MB (5532241) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782429650) - RowsProduced: 191.69K (191694) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s100ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 3s268ms - TotalThreadsSysTime: 21.647ms - TotalThreadsUserTime: 58.572ms - TotalThreadsVoluntaryContextSwitches: 395 (395) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s148ms - ExecTreeExecTime: 8.000ms - OpenTime: 20.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s128ms, non-child: 28.000ms, % non-child: 2.48%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 6.24 MB, 6.24 MB, 36.32 MB - NetworkThroughput: (Avg: 99.45 MB/sec ; Min: 29.20 MB/sec ; Max: 329.87 MB/sec ; Number of samples: 1880) - RpcNetworkTime: (Avg: 263.922us ; Min: -353969.000ns ; Max: 788.837us ; Number of samples: 1890) - RpcRecvrTime: (Avg: 4.923ms ; Min: 16.829us ; Max: 937.513ms ; Number of samples: 1890) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 191.69K (191694) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 24.000ms - TotalBytesSent: 43.13 MB (45228300) - UncompressedRowBatchSize: 94.27 MB (98844440) HDFS_SCAN_NODE (id=2):(Total: 8.000ms, non-child: 8.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/940.83 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s168ms - Open Started: 20.000ms (20.000ms) - Open Finished: 20.000ms (0.000ns) - First Batch Requested: 20.000ms (0.000ns) - First Batch Returned: 24.000ms (4.000ms) - Last Batch Returned: 1s164ms (1s140ms) - Closed: 1s168ms (4.000ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 202.60 KB (207465) ; Min: 5.95 KB (6092) ; Max: 594.72 KB (608992) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.63 KB (28290) ; Min: 2.91 KB (2976) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 380.14 KB (389265) ; Min: 40.68 KB (41652) ; Max: 1.01 MB (1053858) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.84 KB (53081) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.33 - BytesRead: 1.10 MB (1149267) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1149267) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484097) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 274.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.18 MB (6475025) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3499550) - RowBatchQueuePutWaitTime: 2s092ms - RowBatchesEnqueued: 192 (192) - RowsRead: 191.69K (191694) - RowsReturned: 191.69K (191694) - RowsReturnedRate: 23.96 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s100ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 10.948ms - ScannerThreadsVoluntaryContextSwitches: 129 (129) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 4.000ms - TotalReadThroughput: 748.22 KB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 20.000ms, non-child: 20.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 1 (1) - CodegenTotalWallClockTime: 20.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 19.745ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 12.000ms Instance 2a45c19935b2f933:e73e98700000000e (host=impala-executor-000-9:22000):(Total: 1s160ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.839 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/944.14 KB Fragment Instance Lifecycle Event Timeline: 1s160ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 28.000ms (4.000ms) - First Batch Sent: 28.000ms (0.000ns) - ExecInternal Finished: 1s160ms (1s132ms) - MemoryUsage (500.000ms): 5.27 MB, 5.27 MB - ThreadUsage (500.000ms): 3, 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.38 - PeakMemoryUsage: 5.28 MB (5532710) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782978636) - RowsProduced: 192.47K (192466) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s104ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 3s268ms - TotalThreadsSysTime: 22.663ms - TotalThreadsUserTime: 64.839ms - TotalThreadsVoluntaryContextSwitches: 400 (400) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s136ms - ExecTreeExecTime: 4.000ms - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s132ms, non-child: 28.000ms, % non-child: 2.47%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 4.17 MB, 4.17 MB - NetworkThroughput: (Avg: 89.11 MB/sec ; Min: 28.08 MB/sec ; Max: 339.93 MB/sec ; Number of samples: 1890) - RpcNetworkTime: (Avg: 295.536us ; Min: -526849.000ns ; Max: 682.790us ; Number of samples: 1900) - RpcRecvrTime: (Avg: 4.902ms ; Min: 14.359us ; Max: 937.610ms ; Number of samples: 1900) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 192.47K (192466) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 12.000ms - TotalBytesSent: 43.29 MB (45390100) - UncompressedRowBatchSize: 94.67 MB (99267320) HDFS_SCAN_NODE (id=2):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/944.14 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 1s160ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 28.000ms (4.000ms) - Last Batch Returned: 1s156ms (1s128ms) - Closed: 1s160ms (4.000ms) - BytesRead (500.000ms): 1.10 MB, 1.10 MB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 203.69 KB (208575) ; Min: 6.19 KB (6339) ; Max: 597.73 KB (612080) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.78 KB (28442) ; Min: 3.07 KB (3148) ; Max: 64.14 KB (65683) ; Number of samples: 22) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 382.30 KB (391480) ; Min: 40.84 KB (41825) ; Max: 1.01 MB (1060034) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 52.13 KB (53383) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 22) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 1.10 MB (1152597) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 1.10 MB (1152597) - DataCacheHitCount: 8 (8) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 4.000ms - MaterializeTupleTime(*): 4.000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 22 (22) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.23 MB (5484566) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 6.21 MB (6509286) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePeakMemoryUsage: 3.34 MB (3500143) - RowBatchQueuePutWaitTime: 2s092ms - RowBatchesEnqueued: 193 (193) - RowsRead: 192.47K (192466) - RowsReturned: 192.47K (192466) - RowsReturnedRate: 48.12 M/sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 2s108ms - ScannerThreadsSysTime: 6.686ms - ScannerThreadsUserTime: 6.254ms - ScannerThreadsVoluntaryContextSwitches: 134 (134) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 1.10 MB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 1.28 MB (1343488) - CumulativeAllocations: 8 (8) - PeakReservation: 1.03 MB (1081344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.03 MB (1081344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 3.689ms - CodegenUserTime: 18.446ms - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms Instance 2a45c19935b2f933:e73e987000000010 (host=impala-executor-000-3:22000):(Total: 1s067ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.838 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/470.66 KB Fragment Instance Lifecycle Event Timeline: 1s067ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 23.999ms (23.999ms) - First Batch Produced: 27.999ms (3.999ms) - First Batch Sent: 27.999ms (0.000ns) - ExecInternal Finished: 1s067ms (1s039ms) - MemoryUsage (500.000ms): 3.41 MB, 3.41 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 39.34 - PeakMemoryUsage: 4.27 MB (4482341) - PeakReservation: 528.00 KB (540672) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1783537850) - RowsProduced: 95.85K (95848) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s035ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 1s079ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 52.501ms - TotalThreadsVoluntaryContextSwitches: 179 (179) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s043ms - ExecTreeExecTime: 3.999ms - OpenTime: 23.999ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=14):(Total: 1s039ms, non-child: 3.999ms, % non-child: 0.38%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 5.37 MB, 5.37 MB - NetworkThroughput: (Avg: 92.99 MB/sec ; Min: 12.83 MB/sec ; Max: 310.02 MB/sec ; Number of samples: 940) - RpcNetworkTime: (Avg: 287.877us ; Min: -505420.000ns ; Max: 1.794ms ; Number of samples: 950) - RpcRecvrTime: (Avg: 7.775ms ; Min: 16.580us ; Max: 937.924ms ; Number of samples: 950) - EosSent: 10 (10) - PeakMemoryUsage: 38.75 KB (39680) - RowsSent: 95.85K (95848) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 21.57 MB (22613130) - UncompressedRowBatchSize: 47.14 MB (49427540) HDFS_SCAN_NODE (id=2):(Total: 3.999ms, non-child: 3.999ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/470.66 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 1s067ms - Open Started: 23.999ms (23.999ms) - Open Finished: 23.999ms (0.000ns) - First Batch Requested: 23.999ms (0.000ns) - First Batch Returned: 27.999ms (3.999ms) - Last Batch Returned: 1s067ms (1s039ms) - Closed: 1s067ms (0.000ns) - BytesRead (500.000ms): 561.39 KB, 561.39 KB - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 512.00 KB (524288) ; Min: 512.00 KB (524288) ; Max: 512.00 KB (524288) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 101.39 KB (103820) ; Min: 3.11 KB (3189) ; Max: 297.35 KB (304482) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 27.65 KB (28314) ; Min: 3.11 KB (3189) ; Max: 64.14 KB (65683) ; Number of samples: 11) - ParquetRowGroupActualReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 528.00 KB (540672) ; Min: 528.00 KB (540672) ; Max: 528.00 KB (540672) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 190.07 KB (194631) ; Min: 20.33 KB (20814) ; Max: 514.59 KB (526937) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 51.84 KB (53081) ; Min: 14.08 KB (14423) ; Max: 64.14 KB (65675) ; Number of samples: 11) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 561.39 KB (574867) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 561.39 KB (574867) - DataCacheHitCount: 4 (4) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 3.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 11 (11) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 4.20 MB (4400405) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 3.09 MB (3237501) - RowBatchQueueGetWaitTime: 3.999ms - RowBatchQueuePeakMemoryUsage: 3.30 MB (3457661) - RowBatchQueuePutWaitTime: 3.999ms - RowBatchesEnqueued: 96 (96) - RowsRead: 95.85K (95848) - RowsReturned: 95.85K (95848) - RowsReturnedRate: 23.96 M/sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 11.999ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.058ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 561.39 KB/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 656.00 KB (671744) - CumulativeAllocations: 4 (4) - PeakReservation: 528.00 KB (540672) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 528.00 KB (540672) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 23.999ms, non-child: 23.999ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 2 (2) - CodegenTotalWallClockTime: 23.999ms - CodegenSysTime: 0.000ns - CodegenUserTime: 21.466ms - CodegenVoluntaryContextSwitches: 1 (1) - CompileTime: 3.999ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 3.999ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 15.999ms Averaged Fragment F04:(Total: 28.000ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 134.40 KB, max: 134.40 KB, avg: 134.40 KB, stddev: 0 completion times: min:5s012ms max:5s012ms mean: 5s012ms stddev:0.000ns execution rates: min:26.81 KB/sec max:26.81 KB/sec mean:26.81 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 1.09 - PeakMemoryUsage: 332.17 KB (340144) - PeakReservation: 128.00 KB (131072) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782498619) - RowsProduced: 1.50K (1500) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 28.000ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 25.914ms - TotalThreadsVoluntaryContextSwitches: 26 (26) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=15):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) - EosSent: 10 (10) - PeakMemoryUsage: 142.19 KB (145600) - RowsSent: 1.50K (1500) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 117.34 KB (120160) - UncompressedRowBatchSize: 249.02 KB (255000) HDFS_SCAN_NODE (id=1): - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 107.94 KB (110534) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 2 (2) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 107.94 KB (110534) - DataCacheHitCount: 2 (2) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 1 (1) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 181.72 KB (186080) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 18.00 KB (18432) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePeakMemoryUsage: 33.00 KB (33792) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 4 (4) - RowsRead: 1.50K (1500) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 334.000us - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 136.00 KB (139264) - CumulativeAllocations: 2 (2) - PeakReservation: 128.00 KB (131072) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 24.694ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms Fragment F04: Instance 2a45c19935b2f933:e73e987000000015 (host=impala-executor-000-1:22000):(Total: 28.000ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.840 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/134.40 KB Fragment Instance Lifecycle Event Timeline: 28.000ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 24.000ms (0.000ns) - First Batch Sent: 28.000ms (4.000ms) - ExecInternal Finished: 28.000ms (0.000ns) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 1.09 - PeakMemoryUsage: 332.17 KB (340144) - PeakReservation: 128.00 KB (131072) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782498619) - RowsProduced: 1.50K (1500) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 28.000ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 25.914ms - TotalThreadsVoluntaryContextSwitches: 26 (26) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 4.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=15):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - NetworkThroughput: (Avg: 19.97 MB/sec ; Min: 13.96 MB/sec ; Max: 50.43 MB/sec ; Number of samples: 20) - RpcNetworkTime: (Avg: 284.119us ; Min: 102.182us ; Max: 470.878us ; Number of samples: 30) - RpcRecvrTime: (Avg: 40.769us ; Min: 16.725us ; Max: 125.805us ; Number of samples: 30) - EosSent: 10 (10) - PeakMemoryUsage: 142.19 KB (145600) - RowsSent: 1.50K (1500) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 117.34 KB (120160) - UncompressedRowBatchSize: 249.02 KB (255000) HDFS_SCAN_NODE (id=1): Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/134.40 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 28.000ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 28.000ms (4.000ms) - Closed: 28.000ms (0.000ns) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 2.04 KB (2084) ; Min: 2.04 KB (2084) ; Max: 2.04 KB (2084) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 2.04 KB (2084) ; Min: 2.04 KB (2084) ; Max: 2.04 KB (2084) ; Number of samples: 1) - ParquetRowGroupActualReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 2.03 KB (2079) ; Min: 2.03 KB (2079) ; Max: 2.03 KB (2079) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 2.03 KB (2079) ; Min: 2.03 KB (2079) ; Max: 2.03 KB (2079) ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 107.94 KB (110534) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 2 (2) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 107.94 KB (110534) - DataCacheHitCount: 2 (2) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 1 (1) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 181.72 KB (186080) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 18.00 KB (18432) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePeakMemoryUsage: 33.00 KB (33792) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 4 (4) - RowsRead: 1.50K (1500) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 334.000us - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 136.00 KB (139264) - CumulativeAllocations: 2 (2) - PeakReservation: 128.00 KB (131072) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 0.000ns - CodegenUserTime: 24.694ms - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 4.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 16.000ms Averaged Fragment F05:(Total: 32.000ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 41.76 KB, max: 41.76 KB, avg: 41.76 KB, stddev: 0 completion times: min:5s012ms max:5s012ms mean: 5s012ms stddev:0.000ns execution rates: min:8.33 KB/sec max:8.33 KB/sec mean:8.33 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 6.95 - PeakMemoryUsage: 414.44 KB (424387) - PeakReservation: 72.00 KB (73728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782428291) - RowsProduced: 7.20K (7200) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.000ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 32.000ms - TotalThreadsSysTime: 4.421ms - TotalThreadsUserTime: 22.359ms - TotalThreadsVoluntaryContextSwitches: 52 (52) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=16):(Total: 8.000ms, non-child: 8.000ms, % non-child: 100.00%) - EosSent: 10 (10) - PeakMemoryUsage: 98.44 KB (100800) - RowsSent: 7.20K (7200) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 566.81 KB (580410) - UncompressedRowBatchSize: 1.44 MB (1512000) HDFS_SCAN_NODE (id=3): - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 81.54 KB (83492) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 81.54 KB (83492) - DataCacheHitCount: 3 (3) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 294.74 KB (301811) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.00 KB (106496) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePeakMemoryUsage: 163.00 KB (166912) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 10 (10) - RowsRead: 7.20K (7200) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 253.000us - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 136.00 KB (139264) - CumulativeAllocations: 3 (3) - PeakReservation: 72.00 KB (73728) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 72.00 KB (73728) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 4.085ms - CodegenUserTime: 20.426ms - CodegenVoluntaryContextSwitches: 9 (9) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 8.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 12.000ms Fragment F05: Instance 2a45c19935b2f933:e73e987000000016 (host=impala-executor-000-5:22000):(Total: 32.000ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-21 23:02:35.843 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/41.76 KB Fragment Instance Lifecycle Event Timeline: 32.000ms - Prepare Finished: 0.000ns (0.000ns) - Open Finished: 24.000ms (24.000ms) - First Batch Produced: 24.000ms (0.000ns) - First Batch Sent: 24.000ms (0.000ns) - ExecInternal Finished: 32.000ms (8.000ms) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 6.95 - PeakMemoryUsage: 414.44 KB (424387) - PeakReservation: 72.00 KB (73728) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.66 GB (1782428291) - RowsProduced: 7.20K (7200) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 8.000ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 32.000ms - TotalThreadsSysTime: 4.421ms - TotalThreadsUserTime: 22.359ms - TotalThreadsVoluntaryContextSwitches: 52 (52) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 24.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 0.000ns - ExecTreePrepareTime: 0.000ns KrpcDataStreamSender (dst_id=16):(Total: 8.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - NetworkThroughput: (Avg: 28.78 MB/sec ; Min: 717.04 KB/sec ; Max: 84.35 MB/sec ; Number of samples: 80) - RpcNetworkTime: (Avg: 265.169us ; Min: 44.031us ; Max: 474.158us ; Number of samples: 90) - RpcRecvrTime: (Avg: 46.137us ; Min: 16.370us ; Max: 140.961us ; Number of samples: 90) - EosSent: 10 (10) - PeakMemoryUsage: 98.44 KB (100800) - RowsSent: 7.20K (7200) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 566.81 KB (580410) - UncompressedRowBatchSize: 1.44 MB (1512000) HDFS_SCAN_NODE (id=3): Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/41.76 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 32.000ms - Open Started: 24.000ms (24.000ms) - Open Finished: 24.000ms (0.000ns) - First Batch Requested: 24.000ms (0.000ns) - First Batch Returned: 24.000ms (0.000ns) - Last Batch Returned: 28.000ms (4.000ms) - Closed: 32.000ms (4.000ms) - FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 5.75 KB (5891) ; Min: 54.00 B (54) ; Max: 11.45 KB (11728) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 5.75 KB (5891) ; Min: 54.00 B (54) ; Max: 11.45 KB (11728) ; Number of samples: 2) - ParquetRowGroupActualReservation: (Avg: 72.00 KB (73728) ; Min: 72.00 KB (73728) ; Max: 72.00 KB (73728) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 72.00 KB (73728) ; Min: 72.00 KB (73728) ; Max: 72.00 KB (73728) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 5.82 KB (5956) ; Min: 190.00 B (190) ; Max: 11.45 KB (11723) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 5.82 KB (5956) ; Min: 190.00 B (190) ; Max: 11.45 KB (11723) ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 81.54 KB (83492) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 81.54 KB (83492) - DataCacheHitCount: 3 (3) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 294.74 KB (301811) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.00 KB (106496) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePeakMemoryUsage: 163.00 KB (166912) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 10 (10) - RowsRead: 7.20K (7200) - RowsReturned: 7.20K (7200) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 253.000us - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 136.00 KB (139264) - CumulativeAllocations: 3 (3) - PeakReservation: 72.00 KB (73728) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 72.00 KB (73728) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 0 (0) - CodegenTotalWallClockTime: 24.000ms - CodegenSysTime: 4.085ms - CodegenUserTime: 20.426ms - CodegenVoluntaryContextSwitches: 9 (9) - CompileTime: 4.000ms - IrGenerationTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2515328) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 8.000ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 12.000ms